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Abstract 

Observations of redshifted Lyman a forest absorption in the spectra of quasistellar objects 
(QSOs) provide a highly sensitive probe of the distribution of gaseous matter in the universe. 
Over the past two decades optical spectroscopy with large ground-based telescopes, and more 
recently ultraviolet spectroscopy from space have yielded a wealth of information on what appears 
to be a gaseous, photoionized intergalactic medium, partly enriched by the products of stellar 
nucleosynthesis, residing in coherent structures over many hundreds of kiloparsecs. 

Recent progress with cosmological hydro-simulations based on hierarchical structure formation 
models has led to important insights into the physical structures giving rise to the forest. If 
these ideas are correct, a truely inter- and proto-galactic medium [at high redshift (z ~ 3), the 
main repository of baryons] collapses under the influence of dark matter gravity into flattened or 
filamentary structures, which are seen in absorption against background QSOs. With decreasing 
redshift, galaxies forming in the denser regions, may contribute an increasing part of the Lya 
absorption cross-section. Comparisons between large data samples from the new generation of 
telescopes and artificial Lya forest spectra from cosmological simulations promise to become a 
useful cosmological tool. 
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1. INTRODUCTION 

The Lyman a forest is an absorption phenomenon in the spectra of background quasistellar 
objects (QSOs). It can be observed in the ultraviolet (UV) and optical wavelength range, from 
the local universe up to the highest redshifts where QSOs are found (currently z~ 5). Neutral 
hydrogen intersected by the line of sight (LOS) to a QSO will cause absorption of the QSO 
continuum by the rcdshiftcd Lya (1215.67 A) UV resonance line. In an expanding universe 
homogeneously filled with gas, the continuously redshifted Lya line will produce an absorption 
trough blueward of the QSO's Lya emission line (independent predictions by Gunn & Peterson 
1965; Scheuer 1965; Shklovski 1965). Gunn &; Peterson found such a spectral region of reduced 
flux, and used this measurement to put upper limits on the amount of intergalactic neutral 
hydrogen. The large cross-section for the Lya transition makes this technique by far the most 
sensitive method for detecting baryons at any redshift. 

Bahcall &; Salpeter (1965) suggested that there should also be a population of discrete 
absorption lines from a more clumpy gas distribution, specifically from intervening groups of 
galaxies. Discrete lines were observed shortly thereafter (Lynds &: Stockton 1966; Burbidge et al 
1966; Stockton & Lynds 1966; and Kinman 1966), but the quest for their precise origin has given 
rise to a long and, at times, controversial debate; only in recent years does the issue appear to 
have been resolved (see below). Soon thereafter, the simultaneous detection of higher order lines 
of the Lyman scries (e.g., Baldwin ct al. 1974) had confirmed the suggestion (Lynds 1970) that 
most of the absorption is indeed from HI Lya. At higher spectral resolution, the Lya forest can 
be resolved into hundreds (in z > 2 QSO spectra) of distinct absorption lines, the appearance of 
which gave rise to the label Lya forest (Weymann et al 1981); see Figure 1. A small fraction of the 
lines hidden in the forest are not caused by HI but belong to UV transitions from several common 
metal or heavy element ions (various ionization stages of C, O, Mg, Si, Fe and Al are most 
frequently seen). These metal lines are invariably associated with strong Lya lines. At column 
densities N(HI) exceeding 10^^ cm~^ the gas becomes optically thick to ionizing radiation and a 
discontinuity at the Lyman limit (912 A) is detectable. In systems with N(HI) larger than ~ 10^^ 
cm~^, selfshielding renders the gas predominantly neutral. The damping wings of the Lorentzian 
component of the absorption profile beginn to be detected from about the same column density, 
reaching their maximum in the " damped Lya systems" . 

The question of whether the majority of the absorption systems are truly intervening at 
cosmological distances from the quasar, or ejected by it, which had received considerable interest 
in the earlier days, is now settled in favor of the intervening hypothesis. The huge momentum 
requirements for ejection (Goldrcich & Sargent 1976), the outcome of the Bahcall &: Peebles test 
(1969; Young et al 1982a) for a random redshift distribution of absorbers to different QSOs, the 
discovery of galaxies at the same redshifts as metal absorption systems (Bergeron 1986), and the 
detection of high metallicity gas in systems close to the QSO and low metallicities more than 
30000 km~^ away from it (Petit jean et al 1994) leave no doubt that most of the systems are not 
physically related to the QSO against which they are observed. 
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The basic observational properties of the Lya forest were established in the late 1970s and 
early 1980s when the combination of 4m telescopes (e.g., the AAT, KPNO, MMT, Palomar) and 
sensitive photon counting electronic detectors (e.g. the University College London's IPCS) first 
permitted quantitative spectroscopy on high redshift QSOs to be performed. Making use of the 
new technology the work by Sargent et al. (1980) set the stage for what for many years has been 
the standard picture of the Lya forest: Lya absorbers were found to be consistent with a new 
class of astronomical objects, intergalactic gas clouds, which are distinct from galaxies (and metal 
absorption systems) by their large rate of incidence (dN/dz) and their weak clustering. Upper 
limits on the gas temperature and estimates for the ambient UV flux and for the cloud sizes 
were found to be consistent with a highly ionized {nni/nH < 10""^) optically thin gas kept at a 
temperature T ~ 3 x lO^K by photoionization heating. Sargent et al (1980) suggested that denser 
clouds in pressure equilibrium with a hotter (ie. more tenuous) confining intercloud medium 
(ICM) could explain the apparent lack of change of these objects with time. It was argued that 
this picture matches the inferred cloud properties better than clouds held together by gravity, and 
there were a number of other appealing features. In the wake of the dark matter-based structure 
formation scenarios, the pressure confined clouds have given way to models where Lya clouds arise 
as a natural immediate consequence of gravitational collapse. These results are discussed later. 

In an earlier review, Weymann et al (1981) introduced a classification of absorption systems 
that is still useful, although some of the distinctions introduced have been blurred by the most 
recent research (Tytler et al 1995; Cowie et al 1995). In particular, the earlier review distinguished 
two classes of absorption systems, physically separated from the QSO environment, according to 
whether they do, or do not, show metal absorption lines in addition to the ubiquituous Lya. For 
most of the Lya clouds detectable with current technology (N(HI) > 10"*^^ cm^^) metal lines with 
metallicities common at high redshifts (Z <10~^ ZQ) are simply below the detection threshold. 
Therefore this classification is simply an observational one. Rather than explore the nature of the 
division, if appropriate, between metal absorbers and Lya systems here we will concentrate on the 
low column density absorbers. The study of metal absorption systems, possibly of great relevance 
to galaxy formation, is left for future review. 

Below we first discuss observational techniques and observed properties of Lya systems 
(using the terms absorption systems, absorbers, clouds interchangeably). Then we turn to various 
models of Lya absorbers, and finally we address some recent results, and speculate about future 
developments. 

2. OBSERVATIONAL APPROACHES 

2.1. Technical Possibilities, Observational Constraints 

Observational progress with traditional Lya studies can conveniently be charted in terms 
of two limiting factors: The spectral resolution, and the signal-to-noise ratio. The early 
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(photographic) spectroscopy in the 1960s typically had to rely on resolutions of 10 - 20 A. 

At optical wavelengths this is barely sufficient to resolve velocity dispersions characteristic of 
galaxy clusters. Later, in particular the combination of echelle spectrographs and CCD detectors 
permitted QSO spectroscopy to be done with 4m telescopes at resolutions as high as R~ 5x10*^. 
QSO observers have been quick to make use of these advances as is obvious from the semantic 
drift of "high resolution": in 1979 it meant 0.8 A (Sargent et al. 1979), in 1984, 0.25 A (Carswell 
et al. 1984), and in 1990, 0.08 A (Pcttini et al. 1990). Naturally, the average signal-to- noise ratio 
per resolution element did not benefit from the increase in spectral dispersion, and a single high 
resolution QSO spectrum required an cmbarassingly large number of nights on a 4m telescope. 
Thus various ways of extracting information from the Lya forest have been developed in parallel. 
Some were tailored to detailed analysis of individual, expensive, high resolution spectra (line profile 
fitting), while others could be applied more automatically to larger samples of low resolution data 
(mean absorption; equivalent width measurements). The 10m Keck telescope with its powerful 
High Resolution Spectrograph (HIRES; Vogt et al. 1994) brought signal-to- noise ratios of ~ 100 
within reach of high resolution (FWHM ~ 7 kms~^) absorption line studies, rendering some of 
the low resolution approaches obsolete. The new limiting factor for large telescope spectroscopy 
is not resolution nor collecting area but manpower - coping (intelligently) with the continuous 
stream of large datasets already, or soon, available from the Keck telescopes, the Magellan, the 
Hobby-Eberly, the ESO-VLT, the MMT, etc. Recently, progress has also come from extending the 
wavelength regime into the UV band with the Hubble Space Telescope (HST) and the Hopkins 
Ultraviolet Telescope (HUT). In particular, the advent of the HST with its high resolution UV 
spectrographs has helped to compensate to some extent for the fact that optical Lya spectroscopy 
can only sample the universe at redshifts larger than ~ 2.5. We can now study the absorber 
properties and the absorber-galaxy connection in the local universe, and, at high redshift, the 
far-UV (rest frame) helium Lya forest. 



The most basic observable of the Lya forest is the quantity originally sought by Gunn and 
Peterson (1965), the flux decrement D, or the mean fraction of the QSO continuum absorbed. It 
has become standard practice to mcasTire the mean flux decrement Da between the Lya and Ly/? 
emission lines (Oke Sz Korycansky 1982): 



where fobs is the observed (=residual) flux, fcont the estimated flux of the unabsorbed continuum, 
and r is the resonance line optical depth as a function of wavelength or redshift. The absorption 
is measured against a continuum level usually taken to be a power law in wavelength extrapolated 
from the region redward of the Lya emission line. A knowledge of the mean absorption allows 



2.2. Low Resolution Spectroscopy: Mean Absorption 
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us, for example, to determine the resulting broadband color gradients in a QSO or high redshift 
galaxy spectrum, as caused by the Lya forest. Measurements of Da from large datasets were 
performed by (among others) Oke & Korycansky (1982), Bechtold et al. (1984), O'Brian et al 
(1988), Steidel k Sargent (1987), Giallongo k Cristiani (1990), Dobrzycki k Bechtold (1991), 
Schneider et al (1991, and refs. therein). Obviously, at the price of getting only one number out 
of each QSO spectrum, this technique gives the most model-independent measurement possible. 

With Da measurements available over a range of redshifts the redshift evolution of the 
Lya forest can be investigated. Here the concept of an effective optical depth TQg{z), as defined 
in Equation (||) becomes useful. If we characterize a Lya forest as a random distribution of 
absorption systems in column density A'^, Doppler parameter b, and redshift z space, such that the 
number of lines per interval dN, dh and dz is given by J-{N, b, z)dNdbdz, then 

Teff = (l - e-^(^'*)) J^{N,b,z)dNdbdz (2) 

Jzi Jbi JNi ^ ^ 

(Paresce et al 1980), for a population of absorbers without spatial or velocity correlations. 
Assuming that the N and b distribution functions are independent of redshift, and the redshift 
evolution of the number density of lines can be approximated by a power law, we can write 
T{N, b, z) = {l + z)tF{N, b), and 

res{z)=^-—^ / / F{N,b)W{N,b)dNdb (3) 

where the rest frame equivalent width is given by = (1 + z)~^Xq^ j dX{l — e^"^). 

This relation enables us to measure the redshift evolution of the number density of Lya 
forest clouds, dM /dz (x {1 + z^ , from the redshift dependence of the effective optical depth 
(Tefj oc (1 + z)^~^^) even if we do not resolve the individual absorption lines (Young et al 1982b; 
Jenkins k Ostriker 1991; Zuo 1993; Press et al 1993; Lu k Zuo 1994). The results of this approach 
are discussed below in the section on Lya forest evolution, together with the conclusions from line 
counting methods. 

The largest uncertainties in D or t^s are probably caused by our ignorance about the precise 
QSO continuum level, against which the absorption is measured. Additional errors stem from the 
amount of absorption contributed by metal lines, which often cannot be identified as such and 
then removed from low resolution Lya spectra. 



2.3. Intermediate Resolution Spectroscopy: Line Counting 

At higher resolution, where it becomes possible to distinguish between discrete absorption 
lines, the distribution of the lines in terms of equivalent width W and redshift z is the next most 
sophisticated tool. Just as the mean absorption D under certain conditions provides a measure 
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of the mean (gas) density of the universe, so does the number of hnes per unit equivalent width, 
(i^M /dWdz essentiahy measure the dumpiness of the Lya forest gas. An exponential distribution 
in W and a power law dependence on (1 + z) have been found to provide a reasonable match to 
the observed line counts (Sargent et al (1980); Young et al (1982b); Murdoch et al (1986)). For 
lines above a rest equivalent width threshold W > 0.16 A, 



dWdz 

with a typical W* k. 0.27 A (Bechtold 1994), and 1.5 < 7 < 3 (see also the discussion on 
redshift evolution below). The multiplicative form of Equation (^) is justified by a relatively weak 
dependence of W* on z (Murdoch et al 1986). The exponential model fits less well for lines with 
W < 0.3 A as the weaker lines are moving off the saturated part of the curve of growth and 
become more numerous. 

Unfortunately, statistics involving the observed equivalent width distribution are not easy to 
interpret in physical terms. The W values are usually obtained by simply measuring statistically 
significant downward excursions from the QSO continuum. Without properly deblending the 
lines (impossible at low resolution) the curve of growth cannot be used to relate W to the more 
meaningful parameters and b. 



2.4. High Resolution Spectroscopy: Voigt Profile Decomposition 

If the Lya forest is seen as an assemblage of redshifted lines the standard arsenal of notions 
and techniques from stellar spectroscopy becomes applicable. For lower resolution data, the 
equivalent width provides a combined measure of line width and strength. In high resolution 
spectra (FWHM < 25 kms^^) where the typical Lya line is resolved, the line shapes are found to 
be reasonably well approximated by Voigt profiles (Carswell et al 1984). Then line width (Doppler 
parameter b (= \/2o")), column density N{HI), and redshift z of an absorption line are the basic 
observables. The statistics of the Lya forest from high resolution studies largely have been cast 
in terms of the distribution functions of these three quantities and their correlations. The main 
advantage of the high resolution approach is the opportunity of determining the shape of these 
distribution functions without parametric prejudices, by directly counting lines with parameters 
in a certain range. 

The standard approach to Voigt profile fitting (Webb 1987; Carswell et al. 1987) relies on 
minimization to achieve a complete decomposition of the spectrum into as many independent Voigt 
profile components as necessary to make the probability consistent with random fiuctuations. 
For stronger Lya lines the higher order Lyman lines can provide additional constraints when fitted 
simultaneously. The absorption lines are measured against a QSO continuum estimated locally 
from polynomial fits to spectral regions deemed free of absorption. A local high order continuum 
fit (as compared to a global extrapolation with a physical model for the QSO continuum) is 
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necessary because the spectra are patched together from many individual echelle orders with 
strong variations in sensitivity. These variations do not divide oT.it completely when dividing 
by the flux of a standard star because the light going through a slit narrow enough to ensure 
slit-width limited resolution varies with the seeing conditions and with the position of the object 
on the slit. When applying a local fit to the continuum the zeroth order contribution tends to be 
underestimated, i.e., the continuum is drawn too low, which is the main drawback of this method. 

Given sufficient spectral resolution, and assuming that Lya clouds are discrete entities (in 
the sense of some of the models to be discussed below) the profile fitting approach is the most 
physically meaningful way of extracting information from the Lya forest. If the absorber is a gas 
cloud with a purely Gaussian velocity dispersion (a thermal Maxwell-Boltzmann distribution, plus 
any Gaussian contributions from turbulence) a Voigt profile provides an exact description of the 
absorption line shape. The Doppler parameter can then be written as the quadratic sum of its 
individual contributions: 



Unfortunately, in most more realistic models of the absorbing gas finite velocity and density 
gradients invalidate the assumptions underlying Voigt profile fitting, and the line parameters may 
have less immediate physical meaning. Departures of the absorption line shape from a Voigt profile 
may contain valuable information about the underlying nature of the absorption systems, and 
different scenarios may have quite different observational signatures. Rotational motion (Weisheit 
1978; Prochaska & Wolfe 1997), gravitational collapse ( McGill 1990; Meiksin 1994; Ranch 1996) 
and galactic outflows (Fransson & Epstein 1982; Wang 1995) have been discussed in terms of the 
likely absorption line shapes they produce. As yet, the quantitative application of these results has 
proven difficult, because of the lack of realistic prototypical models for the actual line formation, 
the rather subtle departures from Voigt profiles expected, and the wide variety of profiles actually 
encountered. 

Non- Voigt profiles can still be fitted as blends of several Voigt profiles, but the information 
about the non-thermal motion is encoded in the spatial correlations between the individual profiles 
(Ranch 1996). Also, there is no guarantee that the number of components necessary for a good 
fit converges with increasing signal-to-noisc ratio. Clearly, for more general line formation models, 
global techniques of extraction the velocity information may be more appropriate. 



In an individual QSO line of sight, observations of the high redshift {z ~ 3) Lya forest can 
extend over a redshift range Az greater than unity. Then we are sampling a significant fraction 




(5) 



3. OBSERVATIONAL RESULTS 



3.1. Redshift Evolution of the Lyman Alpha Forest 
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of a Hubble time, and it is natural to expect to see changes in the absorption pattern, e.g., in the 
rate of incidence of absorption lines with redshift, or in the mean optical depth. 

EVOLUTION OF THE LINE DENSITY An analytic expression (Wagoner 1967, Bahcall & Peebles 
1969) can be given for the number of absorption systems per unit redshift, dj\f /dz, in terms of the 
comoving number density no{z) of absorbers, the geometric absorption cross section (7{z), and the 
Hubble constant Hq: 

dAf _ cno{z)a{z) 1 + z 

dz ~ Ho (l + g„z)V2- ^ ) 

For absorbers with no intrinsic evolution, 

dM j l + z, qo = 

dz {l+zYl\ qo = \ ■ 

The transformation from redshift z to the coordinate X{z) = /q (1 + z)~^{\ + 2qQzY^'^dz (Wagoner 
1967) is sometimes used to take out the mere cosmological redshift dependence, such that dj\f /dX 
= cnQ{z)a{z)HQ^ . 

Peterson (1978) first pointed out an increase in the number of Lya clouds with redshift 
beyond what was expected for a populations of non-evolving objects. At first this result was 
subject to some debate (see the summary by Murdoch et al. 1986), but it is now clear that the 
Lya forest as a whole evolves quite strongly with z. The observationally determined evolution in 
the number of absorbers above a certain column density threshold is usually expressed in the form 

(Sargent et al 1980; Young et al 1982b), where the exponent includes the cosmological dependence. 
Much observational effort has been devoted to studying the redshift number density evolution, 
but unfortunately the resulting conclusions are far from robust. This is because Lya cloud column 
densities A'^ are distributed according to a power law with index /3 ~ 1.5 (see below) so the 
majority of lines in any column density limited sample arc always close to the threshold, and small 
variations in imposing the threshold can cause large changes in the estimated numbers of lines, and 
in 7. Moreover, line blending, and its dependence on spectral resolution, data quality, and redshift 
can make a large difference in the normalization [dM /dz)o, with individual studies differing by a 
factor of two or more (the interested reader may refer to Parnell &; Carswell 1988; Liu &; Jones 
1988; Trevese et al 1992, and Kim et al 1997 for a discussion of blending effects). Each individual 
study has a finite redshift range available so that the uncertainty in the normalization is correlated 
with the exponent 7; the differences between the observed values of 7 exhibit a disturbingly large 
scatter. Thus the line counting approach is unsatisfactory when it comes to redshift evolution. 
Rather than discussing the many individual (and sometimes mutually inconsistent) contributions 
made to this question we will outline some typical results as follows. 
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At lower resolution (FWHM ~ 50-100 kms ^) large samples of lines have been used to 
investigate this topic. The 7 values tend to lie between the low value 7 = 1.89 ib 0.28 obtained by 
Bechtold (1994), {W >0.32 A), and the high one 7 = 2.75 ± 0.29 (for W >0.36 A) from the study 
by Lu et al (1991). High resolution spectra, usually confined to 2; > 2, tend to give an equally 
wide range of values: 7 = 1.7 ± 1.0 (1^ >0.2 A; Atwood et al 1985); 2.9 ± 0.3 (2 < z < 4.5; Cooke 
et al. 1997); 7 = 2.78 ± 0.71 (log AT > 13.77; 2<z< 3.5; Kim et al 1997). At z > 4 the evolution 
appears to be accelerating, with 7 increasing from a value just below 3 to 5.5 (Williger et al 1994). 

EVOLUTION OF THE MEAN ABSORPTION Similar numbers are obtained by methods which 
do not depend on line counting. For 2.5 < z < 4.5, Press et al (1993), measuring Tes{z), derived 
7 = 2.46 lb 0.37. Zuo & Lu (1993), deriving Da from spectra reconstituted from published 
absorption line lists, find 7 = 2.87 it 0.23, but they considered a broken power law with 7 = 2.82 
below and 5.07 above z = 3.11 to give a better fit, which is in agreement with an upturn at 
the highest redshifts. The evolution of the mean absorption Tcff or is indeed a more robust 
measure of change, but its relation to the number of clouds is not entirely straightforward as a 
model has to be relied on for the distribution of absorbers, J-'{N, b, z),the functional form of which 
is a priori unknown. Although usually not taken into account, there clearly is mutual dependence 
of N, b, and z in the form of clustering, and of diff'erential evolution in N and b. Moreover, 
the column density of the lines dominating the absorption changes with redshift (at z ~ 3 lines 
with log N (HI) ~ 14 contribute most), and so does the range of column densities to which the 
measurements of t^s are most sensitive. 

To the surprise of many the first studies with HST of low redshift {z < 1.5) Lya lines (Morris 
et al 1991; Bahcall et al 1991,1993; Impey et al 1996) (see also the paragraph on the low z Lya 
forest below) have discovered more absorption systems than expected from a naive extrapolation 
of any of the high z power law exponents. Moreover, the low 7 = 0.48 zt 0.62 valid from z ~ to 
z 1 gives a dAf /dz that is consistent with a constant comoving density of objects. Accordingly, 
single power law fits attempting to explain both high and low z absorbers fail to account for the 
rapid upturn around z ^ 1 (e.g., Impey et al 1996). 

DIFFERENTIAL EVOLUTION AS A FUNCTION OF LINE STRENGTH A number of authors 
have made the case for differential evolution, as a function of column density or equivalent width. 
At the high column density end, Lyman limit systems (log AT > 17) were found to be consistent 
(Lanzetta 1988; Sargent et al 1989) with a non-evolving population at least out to z = 2.5. 
Therefore the lower column density systems must be evolving faster, given the above 7 values. 
Murdoch et al. (1986) and Giallongo (1991) noted a general tendency toward for slower evolution 
of 7 with increasing W threshold, which could provide continuity between the large 7 for the 
general line population and the non-evolving, optically thick Lyman limit regime. However, other 
studies claim the opposite trend. Bechtold (1994) found that 7 increased from 1.32 ± 0.24 (for 
weaker fines (W> 0.16 A) to 1.89 it 0.28 for strong hues {W > 0.32 A), Similar conclusions are 
reached by Acharya & Khare (1993). Bechtold's weakest lines (0.16 <W< 0.32 A) are consistent 
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with no evolution all, a result in agreement with the Keck study by Kim et al (1997). The latter 
group, and Giallongo (1991) based their conclusions on high resolution data, whereas the other 
papers cited are based on low resolution. Blending cannot be the whole explanation, since the 
present discrepancy persists regardless of resolution. 

CONCLUSIONS We may summarize the more secure results on number evolution as follows: 
Going from z = to z ~ 1 there is no obvious change in the comoving number of the clouds. Then 
between 1 < z < 2 a steep rise sets in, which can be reasonably described by a power law (1 + z)"* 
with index 2 < 7 < 3. At redshifts approaching 2; ~ 4, the upturn appears to steepen further. 
Thus a single power law does not fit the curvature of the dAf /dz vs. z relation well. Differential 
evolution, with stronger lines evolving less rapidly must exist to reconcile the large 7 for most of 
the forest lines with the non-evolving population of Lyman limit absorbers. Some studies suggest 
that the line density at the very low column density range does not evolve much either, in which 
case the rapid evolution inbetween is caused either by a genuine, rapidly changing sub-population, 
or by biases in the analysis which we do not understand properly. In any case, the average optical 
depth is evolving strongly with rgfr oc (1 + z)^~^^ and 7 around 2-3 (for z > 3). 

3.2. The Proximity Effect: Measuring the Ionizing UV Background 

The UV radiation from QSOs has been considered as the most natural origin for the ionization 
of the intergalactic gas (Arons Sz McCray 1969; Rees &z Setti 1970). The finite number density of 
QSOs suggests that there may be inhomogeneities in the ionization state of the Lya clouds near 
each QSO. The term "Proximity Effect" (coined by Bajtlik et al 1988) refers to a relative lack of 
Lya absorption in the vicinity of the background QSO. The effect was first discussed by Wcymann 
et al (1981), who also suggested the currently accepted explanation of increased ionization of 
the clouds by the nearby QSO. Carswell et al (1982) realized that the general increase of the 
absorption line density dAf / dz with redshift was accompanied by a simultaneous decrease of 
dJ\f /dz in each individual QSO spectrum when approaching the QSO's emission redshift. Murdoch 
et al (1986) calling it the inverse effect confirmed and clarified this result. Tytler (1987b) referring 
to the effect as the anomaly, questioned the specific assumption that the reduced absorption is 
caused by the QSO's radiation field. Hunstead et al (1988), and Webb & Larsen (1988) defended 
the earlier interpretation, and in particular the claim that the effect is local to the neigborhood of 
the QSO. 

If the proximity effect is indeed caused by enhanced ionization measuring the intensity of the 
ionizing UV background becomes possible from observations of the density of lines, dAf /dz, as a 
function of the distance from the QSO. Let us assume that in the vicinity of a QSO dAf /dz is 
reduced, presumably owing to the excess ionization of the gas. With increasing distance from the 
emission redshift the QSO's ionizing flux decreases until the UV background intensity begins to 
dominate the ionization of the intergalactic gas. For example, at the point where the background 
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intensity equals the QSO flux, LQ{A'Kr\)~^ (known from photometry), the neutral column density 
of a cloud should be lower by a factor of one half, with a corresponding decrease in dM jdz for 
lines above a given detection threshold. In this way CarswcU et al (1987) performed the first crude 
measurement of the UV background radiation field, obtaining J_2i=3, where J=J_2i x 10~^^ erg 
cm~^ s~^ Hz~^ sr~^ is the intensity at the Lyman limit, 912 A. Bajtlik et al (1988) confirmed this 
result from a larger low resolution sample of 19 QSOs, obtaining J-2i=llo ?• Their measurement 
procedure (adopted by most later studies) consists of fitting the number density of lines per unit 
redshift distance = /(I + zydz 

dX^ \ dz ) o\ l^'K-'rlJ ) 

as a function of the luminosity distance ri, where the background intensity J is the quantity 
desired. The quantity /? is again the exponent of the power law distribution of column densities. 
Lu et al (1991) with a larger sample get identical results. Bechtold (1994) in her even larger 
dataset finds J_2i=3. The largest compilations of high resolution data gave J_2i=0.5 ±0.1 
(Giallongo et al 1996), and J_2i=llo!3 (Cooke et al 1997). None of these studies has found 
evidence for a significant change with redshift (for 1.6 < 2; < 4.1). However, Williger et al (1994) 
and Lu et al (1996) both found lower values (J_2i=0.2) just above 2; ~ 4, in contrast to Savaglio 
et al's (1997) value (J_2i=0.7) for the same redshift which is consistent with no evolution. In any 
case, when going to lower redshifts there appears to be a drastic decline in intensity below z ~ 1.6. 
At < z >~ 0.5 Kulkarni & Fah (1993) obtained J-2i=6 x lO'^ from HST FOS data (Bahcall et al 
1993). 

SYSTEMATIC EFFECTS ? Assuming that the proximity effect really does measure the background 
intensity and not some other environmental effect caused by the QSO (e.g., suppression of neutral 
gas absorption in a high pressure environment) we still know this quantity only to within an order 
of magnitude, and the uncertainty may even be larger than that. This is because, in addition to 
the errors from line counting discussed in the previous section, there are systematic uncertainties 
in the QSO flux. 

Espey (1993) has quantifled the overestimate in the local QSO flux which arises from the 
well known systematic difference between the "actual" redshift of the QSO (as determined from 
narrow forbidden lines) and the redshift of the (usually blue-shifted) broad emission lines that 

define the "QSO redshift" used normally for the proximity effect. The blueshift may typically 
amount to ~ 1500 kms^^. Downward corrections for J correspond to a factor of 2-3 in this case. 
These corrections have been taken account in the work by Williger et al (1994), Lu et al (1996), 
and Cooke et al (1997) but they would reduce for example the Bechtold value by a factor three. 

Other uncertainties more diflacult to quantify (see the review by Bechtold 1995) include 
QSO variability on the ionization time scale of the gas (Bajtlik et al 1988), gravitational lensing 
amplification of the apparent QSO luminosity, and uncertainties in the shape of the column 
density distribution (Chernomordik &; Ozernoy 1993). Gravitational clustering of clouds near the 
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QSOs may cause an excess number of clouds which again would lead to an overestimate of the 
background intensity by a factor up to three (Loeb & Eisenstein 1995). 

The proximity effect measurements beg the question whether there are enough QSOs to 
produce the ionizing background seen, or whether an additional population of sources is needed. 
We may conclude as did Espey (see Espcy 1993, and references therein) that the contribution 
of known QSOs to the background intensity agrees probably within the errors with the intensity 
from this measurement. 

A related debate on whether the QSOs can ionize the IGM has occupied an even larger space 
in the literature. Unfortunately, we cannot do justice to this extended discussion here, but refer 
to some of the references in the section on the Hell Lya forest below. 

3.3. Absorption Line Widths 

By measuring the line widths we may hope to gain insights into the temperature and 
kinematics of Lya clouds. High resolution spectra showed that many low column density 
{Nhi < lO^^cm"^) Lya lines do indeed show widths {b (= \/2a) ~ 10 - 45 kms~^) that are 
consistent with photoionization temperatures (Chaffee ct al. 1983; CarswcU ct al. 1984; review by 
Carswell 1988), though some lines appear to be as wide as 100 kms~^. Median Doppler parameters 
are around bmed ^ 30-35 kms~^, with a largely intrinsic scatter about the mean with standard 
deviation ~ 15 kms~^ (Atwood et al 1985; Carswell et al. 1991; Ranch et al. 1992). The Doppler 
parameters may decrease with increasing redshift. Williger et al (1994) have found an excess of 
lines with lower Doppler parameters b ~ 20kms~^ at z 4. 

Occasionally, a correlation between Doppler parameter and column density has been noted 
(Carswell et al. 1984, Hunstead et al. 1988). However, the reality of this effect has been subject 
to a debate which culminated in the so-called "b-N controversy" (Hunstead &; Pettini 1991; Webb 
&; Carswell 1991; Peacock 1991), when Pettini et al. (1990) suggested that (when looked at with 
high enough resolution) Lya lines had much lower Doppler parameters (mostly b < 22 kms^^) 
than previously thought. There also appeared to be a strong positive correlation between Doppler 
parameter b and column density N. These results were not confirmed by an analysis of another 
QSO spectrum with an identical observational setup (Carswell et al. 1991). The controversy was 
resolved when it was realized that the presence of noise in a spectrum can distort weak line profiles 
and lead to underestimates of the average b values of low column density lines. The problem is 
exacerbated by a detection bias against weak broad lines, which are more difficult to find against 
a noisy continuum and tend to end up below the detection threshold. The combination of these 
effects accounts for both the presence of spuriously low Doppler parameters and the apparent 
b — N correlation seen in these datasets (Ranch et al 1992, 1993). 

RECENT KECK RESULTS Data taken at similar resolution but with much higher signal to noise 



-14- 



ratio with the Keck telescope's HIRES instrument have basically confirmed the earlier 4m results. 

Hu et al. (1995) found the Dopplcr parameter distribution at z ~ 3 to be well represented by a 
Gaussian with a mean of 28 kms^^ and width o" = 10 kms~^, truncated below a cutoff = 20 
kms~^. With increasing redshift, there seems to be a genuine trend to lower Doppler parameters. 
The finding by Williger et al (1994) of evolution in b appears confirmed: Median Doppler 
parameters for relatively strong lines (13.8<logN(HI)<16.0) change from 41 kms~^ (< z >~ 2.3; 
Kim ct al. 1997) to 31 kms~^ (< z >~ 3.7; Lu ct al 1996), with lower cutoffs dropping from 24 to 
15 kms^^ over the same redshift range. The locus of the Pcttini et al (1990) narrow lines in the 
b — N diagram is virtually empty (Hu et al 1995), as expected in data with such a high S/N ratio. 
Kirkman &; Tytler (1997) obtain similar results for the Doppler parameters in their Keck data at 
even better S/N ratios, but they question the significance of the change with redshift, and find 
a lower, mean b of 23 kms~^ (< z >~ 2.7) with a lower cutoff 6c=14 kms^^ at logN(HI)=12.5. 
However, at logN(HI)=13.8 their minimum b at 19 kms~^ is very close to the result of Kim 
et al. 1997, so the analyses may well be consistent. It is conceivable that the discrepancies at 
lower column densities arise once more from the noise bias discussed above which may affect any 
dataset as long as there continues to be a supply of weaker and weaker lines crossing the detection 
threshold with increasing S/N ratio. The differences might lie in a different understanding of what 
constitutes "statistically acceptable fits" or "detectable lines" . A dataset spanning a large redshift 
range, with - most importantly - a homogeneous S/N ratio would be desirable. 

THE TEMPERATURE OF THE IGM FROM LINE PROFILES ? Though narrow lines (5 < 15 
kms~^) are apparently very rare or even absent, this should not be interpreted as indicating a 
minimum temperature of the Lya absorbing gas. The issue is more complex; in analogy with 
other astrophysical situations there arc reasons for which a correlation might be expected between 
the temperature (or velocity dispersion) and the density (or column density) of the gas. Typical 
photoionization equilibrium temperatures should be in excess of 30000 K (e.g., Donahue & Shull 
1991), but temperatures as low as 20000 K can be attained through inverse Compton cooling and a 
decrease of the ionizing spectrum at the Hell edge (Giallongo &; Petitjean 1994). If photo-thermal 
equilibrium is abandoned, adiabatic expansion cooling can lower the temperatures further while 
maintaining high ionization, as suggested by Duncan et al (1991). Currently favored theories 
of Lya clouds that are the result of cold dark matter-based gravitational collapse do predict 
a, b — N correlation with temperatures for low column density clouds even below 10"^ K, as a 
consequence of adiabatic expansion and inefficient photoheating at low densities, while the larger 
column densities are heated as a result of compression during collapse. However, inspite of the low 
temperatures the Doppler parameters of the weak lines are predicted to be large because of bulk 
motion: Nature, in a random act of unkindness, has endowed these cool clouds with a large size 
so that the Hubble expansion dominates the line broadening. Yet, it may be worth trying to track 
down the residual influence of the gas temperature on the line profiles. The lower column density 
systems are at gas densities where the cooling time (for processes other than expansion cooling) 
exceeds a Hubble time. Therefore, the gas retains a memory of the temperature after reheating 
is complete (Miralda-Escude & Rees 1994; Meiksin 1994; Hui & Gnedin 1997), and the process of 
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reheating may have left a record in the Doppler parameter distribution (Haehnelt & Steinmetz 



In absorption hne studies, the column density distribution function (CDDF), i.e., the number 

of absorbers in a given column density bin occupies a similarly, central place (and provides 
similarly vague information) as the luminosity function in the study of galaxies. The observational 
determination of the CDDF relies on a patchwork of techniques, owing to the large dynamic 
range of observable HI absorption. The CDDF can be measured relatively unambigously from 
Voigt profile fitting for column densities between N(HI) greater than a few times 10^^ cm~^, the 
detection limit for typical Keck spectra, to about a few times lO^^cm"^, where the linear part 
of the curve of growth ends. The weakest lines (N(HI) < 10^^ cm^^) are so numerous that they 
begin to overlap, requiring application of confusion corrections (Hu ct al. 1995). Above ~ 10^^ 
cm~^, once a line is saturated, there is a certain degeneracy between a small change in apparent 
line width and a large change in column density. Then the column densities are relatively difficult 
to measure exactly by any means. The situation is complicated further by the appearance of 
noticeable multi-component structure in absorption systems with column densities above 10^^ 
cm~^ {e.g., Cowie et al 1995). Blending among these components due to the large thermal width 
of the (already saturated) Lya can mimick large Doppler parameter/ high column density lines. 
Simultaneous fits to the higher order Lyman lines (which are less saturated owing to their lower 
oscillator strengths) can only help to some degree. Eventually, for systems with column density 
N(HI)> 10"^^ cm~^ the discontinuity at the Lyman limit (LL) can be observed (10^^"^cm~^ 
corresponds to tll ~ 1) giving again a relatively precise measure of the HI column (Lanzetta 
1988; Sargent et al 1989). From N > lO^^-^ on, the damping wings of Lya become detectable. 
The line width is now entirely a measure of the column density and can again be read off by Voigt 
profile fitting, or, in lower resolution data, directly from the equivalent width (Wolfe et al 1986). 

Carswcll ct al. (1984) found that the number of absorbers M per unit HI column density 
interval can be parametrized as 



Tytler (1987a) has drawn attention to the remarkable fact that when results from higher column 
density surveys arc included a single power law with slope /? = 1.5 fits the whole range of 
observable column densities well. Keck spectra (Hu et al. 1995, Lu et al. 1996, Kirkman & 
Tytler 1997, Kim et al. 1997) appear to show that the the power law extends over ten orders of 
magnitude in column density from 10^^ to 10^^ cm~^ (if the confusion correction made at the low 
column density end is justified). A customary working definition of the CDDF (Tytler 1987a) is 
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3.4. The Column Density Distribution 



dN 



oc A^-^, /3 = 1.68 13 < log A^ < 15. 
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which gives the total number M of absorbers in HI column density bin [N, N + /S.N\ , found over 
the total surveyed redshift distance J2i where X has been defined earlier. 

One of the more recent measurements (Hu et al 1995) gives 

/(iV) = 4.9 X lO^iV-^-^^ 12.3 < log iV < 14.5 (12) 

Various authors (Bechtold 1987; Carswell et al 1987, Petitjean et al. 1993; Meiksin & Madau 
1993; Giallongo et al 1993) have presented evidence for departures from a single power law which 
seem to be borne out by the new Keck data. A steepening for log A'^ > 14 explains why individual 
high resolution spectra tend to yield f3 ~ 1.7 — 1.8 for the regions (logiV ~ 13-15) for which 
they are most sensitive (e.g. Carswell ct al. 1984,1987: Atwood et al 1985; Rauch et al 1992). 
In the high column density range (beyond logA^ ~ 16) f{N) flattens and damped systems are 
more abundant than they should be judging from an extrapolation of the lower column density 
power law. Weak evolution of f{N) may occur in the sense that this turnover moves slightly with 
redshift (Carswell et al 1987, Kim et al. 1997) but the evidence is currently not overwhelming, 
given that the dip in f{N) occurs in a column density range, where the determination of N(HI) is 
least certain (see above). 



3.5. Spatial Structure along the Line of Sight: Clustering and Voids 

Measurements of the two-point correlation function (TPCF) in velocity space along the 
LOS, ^(At;), led Sargent et al (1980) to conclude that Lya clouds are not clustered as strongly 
as galaxies. Given the probability Ap of finding a pair of clouds with absorption cross section 
a and space density no{z), separated by a velocity interval Av, ^{Av) is given by the following 
expression: 

Ap = noaAv[l + CiAv)], (13) 

where Av = cAz/{l + z) is the velocity splitting in the rest frame at mean redshift z. No 
correlation signal was found on scales of Av between 300 and 30000 kms~^. Clustering for small 
line pair splittings {Av < 300 kms~^) would still be consistent with this result, given the limited 
resolution, and the effects of blending caused by the large line widths. Based on Voigt profiles 
fits to high resolution data Webb (1986) obtained the first evidence for the presence of a weak 
clustering signal (^^(100 kms~^) ~ 0.5, at z ~ 2.5) at small separations. This result has been 
confirmed by others (e.g., Muecket & Mueller 1987; Ostrikcr ct al 1988). It is hard to detect the 
clustering at a high level of significance in any individual QSO spectrum because of the short 
redshift path length, and both detections and non-detections have been reported (Kulkarni et 
al 1996; Rauch et al 1992). A variety of techniques seem to indicate, however, that there really 
is weak clustering in the z ~ 3 forest on small scales. If Lya lines are considered as blends of 
components with intrinsically narrower line widths the clustering amplitude could be much higher 
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(Rauch et al 1992). In particular, the strong clustering seen among metal absorption lines is 
largely invisible in Lya because of blending between the saturated Lya components associated 
with the metals. It is perhaps not that surprising that a Lya clustering amplitude, increasing with 
HI column density was actually reported (Chernomordik 1994; Cristiani et al 1995, 1997), and has 
been related to the clustering seen in metal absorption lines (Cowie et al 1995; Fernandez-Soto et 
al 1996). Earlier, Crotts (1989), by measuring the correlation in real space across the sky among 
systems in multiple LOS had reported an increase of clustering with Lya equivalent width. 

STRUCTURE ON VARIOUS SCALES The amplitude of the TPCF is not the only tool for measuring 
structure in the forest. In low resolution data, blends caused by clustering show up as a distortion 
in the equivalent width distribution of Lya lines, such that in the clustered case there are more 
large equivalent width lines and fewer small ones than for a random distribution of lines in velocity 
space (Barcons k. Webb 1991). A number of other approaches, mostly equivalent to the hierarchy 
of correlation functions, or parts thereof (White 1979) may give a more robust clustering signal 
on small scales by inchiding higher order correlations. Especially, the void probability function 
and, more generally, neighbor statistics ((Ostriker, Bajtlik &; Duncan 1988; Liu k, Jones 1990; 
Fang 1991; Meiksin & Bouchet 1995) have been used, invariably revealing the non-Poissonian 
(clustered) nature of the distribution of clouds in velocity space (Ostriker et al 1988; Bi et al 1989; 
Liu & Jones 1990; Babul 1991). 

Structure has been detected on many different scales, in addition to the smale scale clustering 
described above: Fang (1991) used a Kolmogorov-Smirnov test for nearest neighbor intervals to 
detect a signal on scales 30-50 h~^ Mpc (where h is the present day Hubble constant in units of 
100 kms~^Mpc~^). Mo et al (1992), from an analysis of the extrema in the slope of the TPCF 
saw structure at 60 and 130 h~^ Mpc. Meiksin &; Bouchet (1995) found an anti-correlation in the 
TPCF around 3-6 h~^ Mpc. Pando k. Fang (1996), applying the wavelet transform, found clusters 
~ 20 h~^ Mpc in size in the Lya forest. The physical interpretation of the various results is not 
entirely obvious. The usefulness of the data for large scale structure analyses has always been 
accepted at face value, and it would certainly be entertaining to see whether there are systematic 
effects in the data, perhaps causing some of the structure. There are intrinsic scales in the spectra 
(like the quasi-periodic change in S/N ratio caused by the sensitivity maxima of the orders in an 
echelle spectrum) which are of similar magnitude (~ 5000 kms~^, or ~ 25 h~^ Mpc comoving at 
z~ 3) as some of the above detections. 

Most of the clustering work is based on analyzing correlations between distinct absorption 
lines. Including information about the relative strength of the absorption as a function of velocity 
splitting can improve the significance of any correlations, and give clues to the mechanism causing 
the signal. Webb k Barcons (1991) and Zuo (1992) have suggested correlating equivalent widths, 
rather than just lines above a detection threshold to search for inhomogeneities in the gas pressure 
or ionizing flux along the line of sight. Fardal k ShuU (1993), Press et al (1993), and Zuo k 
Bond (1994) have extended this approach to statistical models of the pixel intensity correlations, 
a technique useful for disentangling line widths and small scale clustering on overlapping scales. 
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VOIDS IN THE FOREST A specific discussion revolved around the question whether there are 
voids in the Lya forest, similar in comoving size to those seen in the local galaxy distribution. In 
principle verifying the existence of a void large enough to have a vanishing probability of occuring 
by chance, if drawn from a Poissonian distribution, is straightforward. The probability function 
for a Poissonian gap of size /S.z in a spectrum with absorption line density cLhf /dz is simply 



Carswell & Rees (1987) concluded that voids with sizes like those in the local universe (~ 50 
h~^ Mpc (comoving)) cannot fill more than 5 % of the volume at < z >~ 3.2. This result was 
confirmed by work by Duncan et al (1989), based on a larger dataset. A similar conclusion was 
reached by Pierre et al (1988), who found that the Lycc absorbing gas cannot exhibit a void 
structure that is similar to that of low redshift galaxies, without producing strong clustering 
inconsistent with the observations. 

Nevertheless, individual large gaps have been found. Crotts (1987), discovered an 43 h~^ Mpc 
gap towards Q0420-388. This result was variously contested and confirmed in a dispute about 
significance levels (Ostriker et al 1988; Crotts 1989; Duncan et al 1989; Bi et al 1991, Ranch et 
al 1992), fuelled, among other things by the lack of a universally adopted definition of the term 
"void" which takes into account that a void may be void of lines only down to a certain detection 
threshold. It turned out that Crotts' gap, though not entirely empty, is a region of significantly 
lower line density. Dobrzycki & Bechtold (1991) found another void of size ~ 32 h-i Mpc in the 
spectrum of Q0302-003, and Cristiani ct al (1995) discovered a significant pair of smaller voids 
towards Q0055-269. To summarize, the Lya forest does show the occasional gap, but the void 
structure apparent in the local galaxy population is not present in Lya absorbing gas. 

The origin of the rare voids has most often been discussed in connection with a local proximity 
effect: A foreground QSO near the LOS to the more distant QSO produces a "clearing" by ionizing 
the adjacent clouds seen in the LOS to the other object (Bajtlik et al 1988; Kovner &; Rees 1989). 
No clean-cut evidence has been found for this effect in the few studies done to date (Crotts 1989; 
M0ller & Kjaergaard 1991), nor has it been possible to rule out its existence (e.g., for the 0302-003 
void, see Dobrzycki & Bechtold 1991; Fcrnandcz-Soto ct al 1995). Several effects can complicate 
the analysis. Short of abandoning the idea of the proximity effect as an excess of ionization 
caused by a nearby QSO, anisotropic emission (beaming) by the QSO, and QSO variability can be 
invoked to explain the non-detections and the discrepancies between the redshift positions of QSO 
and candidate voids. The number of free parameters in such models is currently of the same order 
as the number of voids observed, suggesting that studies of individual voids will probably not be 
of great use for some time. With a sufficiently large dataset, global searches for fluctuations in the 
absorption pattern caused by an inhomogeneous radiation field (Zuo 1992; Fardal & Shull 1993) 
may have a better chance of success. However, Haardt & Madau (1996) have recently pointed out 
that the diffuse recombination radiation from Lya clouds themselves (which can provide on the 
order of 30% of the ionization rate) can considerably reduce the fluctuations. 
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3.6. Spatial Structure Across the Sky: Multiple Lines of Sight 

The lack of two-dimensional information is one of the main shortcomings of high redshift 
QSO spectroscopy. This problem makes it hard to understand the geometry of the absorbers, and 
to disentangle positions in velocity and real space. Through observations of common absorption 
systems in spatially separated LOS (multiple images of gravitationally lensed QSOs, or QSO 
pairs) the spatial dimcnsion(s) across the sky can be restored to some degree. Gravitationally 
lensed QSOs have maximum image separations up to a few arcseconds, giving information on 
scales < 100 kpc. In contrast, QSO pairs rarely occur closer to each other than a few arcminutes, 
which limits the scale that can be probed at high redshift to larger than a few hundred kpc. The 
presence or absence of common absorption in two LOS gives an indication of the coherence length 
of the absorber. Obviously, common absorption systems must be at least as large as the transverse 
separation between the beams to appear in both LOS. If some of the systems are missing in one 
image, a maximum likelihood estimate based on the binomial probability distribution for the 
fraction of "hits" and "misses" can be used to estimate the mean extent of the absorbing cloud 
across the sky (McGill 1990). 

GRAVITATIONALLY LENSED QSOS The first gravitational lens discovered, the z=1.39 QSO 
Q0957+561 (Walsh et al 1979) enabled Young et al (1981) to put a lower Umit of ~ 7 kpc on the 
size of an intervening CIV absorption system common to both LOS. Another notorious lensed 
QSO, 2345+007 A,B yielded lower limits to the size of Lya clouds of 1-11 h~^ kpc (at z~ 2) 
(Foltz et al 1984; McGill 1990); the uncertainty comes from the unknown position of the lensing 
object. This scale, though strictly an upper limit, came to be considered as a typical "size" for 
several years, until the observations of UM 673 (z=2.73; lens at z^' 0.5, LOS angular separation 
2.2 arcseconds) by Smette et al (1992) showed two virtually identical Lya forests in the A and B 
images, with equivalent width and velocity differences consistent with the measurement errors. 
With LOS proper separations ranging up to lh~^ kpc for Lya systems a 2-a lower limit of 12h~^ 
kpc to the diameter of the clouds (which were assumed to be spherical) was obtained. Observations 
of another bright lensed QSO (HE 1104-1805 A,B) by Smette et al (1995a) produced even more 
stringent lower limits to cloud diameters of 25h^^ kpc. These remarkable results seem to indicate 
that the Lya forest absorbers are not consistent with the relatively small clouds envisaged in the 
pressure confined model, nor are they consistent with the possibility that the absorption of a 
significant fraction of the systems could arise in the virialized regions of galaxies, or could exhibit 
the small scale variations typical of the interstellar medium. 

Unfortunately, very few lensed objects are suitable targets for Lya spectroscopy: At least 
two images must be bright enough to be observed at high resolution; the image separation must 

exceed typical seeing conditions (> 1.5 arcseconds); the emission redshift must be sufficient to 
shift the Lya forest into the optical wavelength range. The apparent lack of structure of the forest 
over several kpc and the limited angular separation of lensed LOS make observations of QSO pairs 
more suited for studying the large scale structure of the Lya forest proper. Lensed QSOs however. 
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should become increasingly useful for the study of metal absorption systems and high redshift 
galaxies, a topic which is beyond the scope of this review (see Smette 1995b). 

QSO PAIRS In view of the crowding in the high redshift Lya forest and the relatively large 
separations between most QSO pairs, the cross-identification of individual absorption systems 
in the two LOS can be difficult, and detections of coherent absorption across the sky may be 
significant only in a statistical sense. Sargent et al (1982) applied a cross-correlation analysis to 
the spectra of the QSO pair near 1623+26 (Sramek & Weedman 1978; see also Crotts (1989), who 
included two additional QSOs near this pair). With transverse separations ~ l-2h~^ Mpc the 
LOS were well-suited for searching for the large coherent absorption pattern predicted by some 
theories. Oort (1981), for example, had suggested that the Lya forest was caused by intergalactic 
gas distributed like low redshift "superclusters" . Sargent et al (1982) concluded that there is too 
little coherence between the systems across the plane of the sky to agree with the large "pancake" 
structures envisaged by Oort. 

However, evidence for very large structures seen in the much less densely populated CIV 
forest suggests that some of the coherent absorption in the Lya forest is being missed because of 
the difficulty of cross-identifying absorbers. Therefore, examples of gaseous structures with large 
coherence usually have come from high column density systems. Shaver k, Robertson (1983) saw 
common absorption over ~ 380 h-^ kpc at z~ 2 in metal absorption systems (Q0307-195A,B). 
Francis & Hewett (1993) found coincident damped Lya absorption over ~ 3h~^ Mpc across the 
sky. Considering the firm lower limits from gravitational lensing there was reason to expect large 
sizes for the low column density forest as well, and such evidence was eventually found: Optical 
MMT data of the unusually close QSO pair Q1343+266A,B (also known as Q1343+264A,B; 
separation of 9.5 arcseconds) showed absorbers extending over several hundred kpc at redshifts 
just below 2 (Bechtold et al 1994; Dinshaw et al 1994). Even larger sizes appear to occur at 
somewhat lower redshift. Dinshaw et al (1995) deduced a most probable diameter of 360 kpc 
for 0.5 < z < 0.9. from HST FOS spectra of the Q0107-25A,B pair. A later rc-analysis points 
to a median diameter of ~ 0.5h^^ Mpc for Q1343+266 and and ~ 1 /i^^ Mpc for the lower z 
Q0107-25A,B (Fang et al 1996). The velocity difference between lines in different LOS assumed 
to belong to the same absorption system however, are small, with a intrinsic mean difference of 
only ~ 50 kms~^. Fang et al (1996) found a trend for the size estimate to increase with separation 
between the LOS, which is indicative of spatial coherence on a range of scales, the upper end 
of which may not have been sampled yet. Most of these studies assumed spherical clouds, but 
from photoionization arguments spherical objects consistent with the measured sizes and column 
densities would be so highly ionized as to easily overfill the universe with baryons. The simplest 
explanation, which allows for a denser and more neutral gas while remaining consistent with the 
transverse sizes assumes that typical Lya clouds are flattened, with a thickness on the order of ~ 
30 kpc, for transverse sizes of 1 h"^ Mpc (Ranch &; Haehnelt 1995). 

The large sizes, the small velocity and column density differences, the possible absence of a 
unique size scale, the apparent flatness of the clouds found at high and intermediate redshifts, and 
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the general absence of voids all argue against an origin of the typical (i.e., low column density, 
log N < 14) Lya forest line in potential wells of already formed galaxies. 

4. THE FIRST GENERATION OF MODELS 

Theoretical modelling of absorption systems can be traced back to Spitzcr's (1956) prediction 
(expanded by Bahcall & Spitzer 1969) that normal galaxies have large gaseous halos giving rise 
to heavy clement UV absorption lines. Bahcall & Salpeter (1965) considered groups of galaxies, 
Arons (1972) suggested forming low mass protogalaxies as the probable sites of Lya absorption. 
The interpretation by Sargent et al 1980 of their observations of the Lya forest alerted researchers 
to differences between metal and Lya forest absorption systems, with the evidence pointing away 
from galaxies, to distinct astronomical objects, intergalactic gas clouds. 

4.1. Lya Clouds confined by the Pressure of an Intercloud Medium 

If the Lya absorbers correspond to overdcnsc clumps of gas, their persistence throughout 
of the history of the universe must be either due to only a slow change in their properties, or 
to replenishment of the clouds on a shorter time scale. An apparent lack of rapid evolution in 
the properties of the forest (later shown to be a statistical fluke), and the short electron and 
proton relaxation time scales and mean free paths appeared to justify treating the clouds as 
"self-contained entities in equilibrium" (Sargent ct al 1980). A two phase intergalactic medium 
was postulated, with the hot, tenuous intercloud medium (ICM) in pressure equilibrium with the 
cooler and denser Lya clouds. The standard version of the pressure confinement model (Sargent et 
al 1980; Ostriker & Ikeuchi 1983; Ikeuchi & Ostriker 1986) considers spherical, and, since gravity 
is ignored, homogeneous clouds. This model is self-consistent, but there are no very compelling 
physical reasons for preferring pressure to gravitational confinement or to no confinement at all, 
and the possibility of self-gravitating clouds as an alternative was discussed soon (Melott 1980; 
Black 1981). 

Nevertheless, the pressure confinement model for Lya clouds is appealing for several reasons: 
It combines the concept of a multiphase structure of the intergalactic medium, familiar from the 
interstellar medium, with the idea of separate entities, "clouds", in analogy to, but different from 
galaxies. A hot intercloud medium may have been a possible source of the X-ray background. 
In addition the explosion scenario (see below) provided a theory of cloud formation. Finally, the 
model made testable predictions, a rare but risky undertaking for astrophysical theories, which 
paved the way to its eventual demise. 

The basic properties of pressure confined clouds, as worked out in detail by Sargent et al 
(1980), Ostriker Sz Ikeuchi (1983), and Ikeuchi Sz Ostriker (1986) can be summarized as follows: 
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The Lya clouds are supposed to be in photoionization equilibrium with an ionizing UV 

background. The gas is heated by photoionization, and cools via thermal bremsstrahlung, 
Compton cooling, and the usual recombination and collisional excitation processes. The cloud 
evolution consists of several phases, depending on the relative lengths of cooling and expansion 
time scales. The ICM is expanding adiabatically by the cosmic expansion at all times because the 
high degree of ionization does not allow for efficient photoionization heating. The denser clouds 
embedded in the hot ICM start out in isothermal expansion with a temperature fixed by thermal 
ionization equilibrium (Tc ~ 3 x W^K), until the density ric oc Picm/Tc oc (1 + z)^ has dropped 
sufficiently that photoheating cannot compensate for the work of expansion any longer, and the 
clouds begin to cool and to expand less rapidly. The sound speed drops even faster so ultimately 
pressure equilibrium with the ICM ceases and the clouds enter free expansion. The available 
range of cloud masses is constraint by the requirements that the clouds must be small enough 
not to be Jeans-unstable, but large enough not to be evaporated rapidly when heated by thermal 
conduction from the ambient ICM (Sargent et al 1980, Ostriker & Ikeuchi 1983). Clouds formed 
at z ~ 6 would survive down to accessible redshifts (~ 4) only if their masses range between 
10^ < Mc <10i° Mq. 

THE ORIGIN OF LYMAN ALPHA CLOUDS FROM COSMIC SHOCKS The explosion scenario of 
structure formation (Schwarz et al 1975; Ostriker &: Cowie 1981) provided a non-gravitational 
origin for the pressure confined Lya clouds. Large scale explosions from galaxies (e.g., from 
starbursts) and QSOs may have driven shock waves into the intergalactic medium. These events 
may also have provided the energy for collisional re-ionization and heating of the ICM, since 
photoionization cannot produce temperatures high enough to maintain pressure confinement 
(Ikeuchi & Ostriker 1986). This way a two-phase medium of hot "cavities" enclosed by a system of 
cooler shells could have arisen (Ozernoy &: Chernomordik 1976). Lya absorption is caused by the 
fragmenting shells (Chernomordik &: Ozernoy 1983; Vishniac et al 1985). Among the observational 
consequences may be pairs of Lya lines that occur wherever the line of sight intersects an 
expanding, spherical shell. It has been argued that such pairs have been seen (Chernomordik 
1988, and refs. therein); this may be the case in individual systems, but it is difficult to prove 
in a statistical sense because the two-point correlation docs not show the expected signal at the 
relevant velocity scale, ~ 100 kms~^ (Ranch et al. 1992). A potential problem for this model is 
implied by the observed lack of a correlation with galaxies. If Lya clouds are shells expelled by 
galaxies, the absorbers should be clustered in a manner similar to that of galaxies (Vishniac & 
Bust 1987). Neither the auto-correlation function among absorbers nor the cross-correlation with 
galaxies show a signal of the requisite strength (Barcons &; Webb 1990). 

A similar pattern of shell formation ensues if QSOs, in the initial event of reionization, 
surround themselves with Stromgren spheres (Arons & McCray 1969, Shapiro & Giroux 1987), 
which can lead to shocked shells of gas at the boundary of the HII regions. The shells fragment as 
in the explosion scenario and may be visible as Lya absorbers (Madau & Meiksin 1991). 
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THE ELUSIVE INTERCLOUD MEDIUM The need for a confining intercloud medium has led to 

a number of searches for a residual absorption trough between the absorption lines, caused by 
the HI in the intercloud space. These measurements came to be referred to in the literature as 
the Gunn-Peterson (GP) test, though Gunn k. Peterson's (1965) original result of a 40% average 
absorption was a detection of the unresolved Lya forest as a whole. Values for the residual 
(i.e., intercloud, or diffuse, as opposed to line) GP effect require (a) a precise knowledge of the 
unabsorbed QSO continuum level, and (b) either subtracting the contribution from Lya "lines" , 
or the use of line free regions (whatever that may be) for the estimate. Steidel & Sargent (1987b) 
measured the total flux decrement of a sample of 8 QSOs against continua extrapolated from the 
regions redward of Lya emission. After subtracting a model population of discrete Lya lines they 
obtained a residual top < 0.02 ±0.03 (< z >~ 2.67), i.e., a null result. Giallongo et al (1992), and 
Giallongo et al (1994) have compared apparently line free regions with an extrapolated continuum, 
and they found tgp < 0.013 ± 0.026(< z >~ 3) and {tgp < 0.02 ± 0.03(< z >~ 4.3), respectively. 
Given the line crowding at high redshift, the small error bars of the z > 4 work betray a certain 
degree of optimism. 

The clean-cut decomposition into line and continuum absorption makes theoretical sense 
for pressure conflncd clouds, but observationally we can never be sure whether there is a flat 
continuum trough from diffuse gas, or whether there are many weak lines blended together. 
Jenkins &; Ostriker (1991), and Webb et al (1992), acknowledging this problem, attempted to 
model the pixel intensity distribution with continuum absorption and variable contributions from 
discrete lines. Their results show that top can be produced both ways, by blending of weak lines 
below the detection threshold, or by a constant pedestal of absorption. 

In any case the weakness or non-detection of a residual GP trough puts an upper limit on the 
density of the ICM. A lower limit on the ICM pressure (oc uicmTicm) can be derived from the 
absorption line width (which gives an upper limit on the radius of the expanding cloud (Ostriker 
&; Ikeuchi 1983). The condition that the cloud must be large enough not to evaporate gives an 
upper limit on the pressure. Another independent upper limit on the pressure of the ICM comes 
from the lack of inverse Compton distortions in the spectrum of the cosmic microwave background 
(CMB) (Barcons et al 1991). This result rules out the intergalactic medium as the source of the 
hard X-ray background. It also may spell trouble for the explosion model of galaxy formation, 
which is the origin of the two-phase IGM in the current picture) and of apparently non-existing 
structure in the CMB. When all the limits are combined all the limits only a relatively small 
corner of allowed (n, T) parameter space remains for the intercloud medium. 

PROBLEMS WITH THE COLUMN DENSITY DISTRIBUTION For pressure confined clouds the 
large range of neutral hydrogen column densities observed must correspond to a range in the 
parameter combination 

N{HI) oc MV3r-29/i2 J-^P-^/^ (15) 
To reproduce only the low column density systems between 13 < log N{HI) < 16 the mass has 
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to vary by 9 orders of magnitude, or the radiation field by 3 orders, or the pressure by a factor 
of 63. To ensure cloud survival the mass range is limited to less than 4 dex (see above), and 
the temperature is constant; therefore, we may need to invoke pressure inhomogcncitics (Baron 
et al 1989). However, Webb &: Barcons (1991), looking for pressure related spatial correlations 
among the equivalent widths of Lya forest lines excluded pressure fluctuations AP/ P > 14% at 
the 2(7 level, and a similar limit must hold for the radiation field J. Extremely flattened clouds 
would help somewhat in that they would increase the column density range, allowing a wider 
range of path lengths through the clouds (Barcons & Fabian 1987), but that may introduce other 
problems. Williger & Babul (1992) taking these constraints into account investigated pressure 
confined clouds with detailed hydrodynamical simulations and found that the small mass range 
leads not only to a failure in producing the column density range but also to a faster drop in the 
number of clouds with redshift, than observed. 

To summarize, the pure pressure confinement model is unlikely to explain the Lya forest as 
a whole, though it is clear that some LOS must go through sites where gas is locally confined by 
external hydrostatic or ram pressure. Low redshift gaseous galactic halos, the likely hosts of the 
dense Lyman limit absorbing clouds, may be such environments. Formed by local instabilities the 
dense clouds may be in pressure equilibrium with a hot gas phase at the virial temperature of the 
halo (Mo &; Miralda-Escude 1996, and references therein). 

4.2. Gravitational Confinement: Selfgravity 

Self-gravitating baryonic clouds were suggested by Mclott (1980) as an alternative to 
the pressure confinement model. Black (1981) investigated in detail the physical structure 
of such objects, clouds. He found that (quasi-)stable clouds with properties consistent with 
the observations have to be extended (~1 Mpc), and must either be truncated by an external 
medium, or be large enough to overlap, providing their own boundary pressure. In this model 
the appearance of the intergalactic medium as a forest of lines is more due to the strong internal 
gradients of the neutral gas density, than to a sharp transition between separate entities. The 
density of the intergalactic medium along the LOS undulates, and there is no real difference 
between an intercloud medium and the clouds. The huge sizes would also have been able to 
reconcile a larger mass density of the intergalactic medium with the observed cloud parameters, 
whereas pressure confined clouds would contain only a small fraction of all baryons. The model 
met with scepticism because the large sizes appeared to contradict the scant observational 
evidence. However it may also have other problems, such as reproducing the column density 
distribution (Petitjean et al 1993a). 
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4.3. Gravitational Confinement: Clouds Dominated by Hot Dark Matter Gravity 

The advent of ab initio theories of gravitational structure formation made it possible to place 
the Lja forest in a larger frame, and investigate its relation to galaxy formation. In principle, the 
number density, sizes and physical parameters of the absorbers can be predicted as a consequence 
of cosmological models, though, until recently this has been wishful thinking. 

ZELDOVICH PANCAKES The first such theory to explicitly address the Lya forest phenomenon 
was the hot dark matter (HDM) model. The formation of adiabatic pancakes suggested by 
Zeldovich (1970) is expected to produce a primordial gas phase with the right properties for 
detection in HI absorption (Doroshkevich & Shandarin 1977). Among the interesting consequences 
of this theory are the large (in fact: too large) sizes of the pancakes. Even after fragmentation, 
coherent absorption should be extending over Mpcs across the sky (Doroshkevich &; Muecket 1985) 
thus explaining the large transverse sizes seen later in QSO pair studies. In a prescient paper, 
Oort (1981), at the time referring to HDM pancakes, suggested identifying Lya absorbers with 
collapsed but uncondensed gas in the "super clusters" of galaxies known from low redshift. He 
calculated the gravitational scale height of a sheet of gas, and noted the similarity of the mean free 
path between Lya clouds and the distances between superclusters. The very large transverse sizes 
expected (~ 20 Mpc, at z ~ 2) were not confirmed, however, by the QSO pair study of Sargent et 
al (1982), so such objects cannot be the rule. 

The underlying HDM structure formation scenario has become somewhat unpopular, but the 
physical idea of Lya absorbers as flattened pancakes survives into the currently favored, CDM 
based picture (see below). However, the CDM pancakes (or sheets) are more than an order of 
magnitude smaller than the Zeldovich ones, and they form late, after denser structures like knots 
and filaments are already in place (Cen et al 1994; Bond et al 1996). 

4.4. Gravitational Confinement: Cold Dark Matter Minihalos 

The properties of gas clouds under the influence of the gravitational field of dark matter have 
been investigated by Umemura & Ikeuchi (1985), and, more specifically in terms of the "minihalo" 
model by Rees (1986) and Ikeuchi (1986). In this picture, Lya clouds are a natural by-product 
of the CDM structure formation scenario. Photoionized gas settles in in the potential well of 
an isothermal CDM halo. The gas is stably confined, if the potential is sufficiently shallow to 
avoid gravitational collapse but deep enough to prevent the warm gas from escaping. The CDM 
minihalos are more compact than the self-gravitating baryonic clouds of Black (1981) because 
of the larger dark matter gravity. The detailed structure of the halo depends on the relative 
spatial distribution of baryons and CDM. The models can be parametrized by the intensity of the 
radiation field J, the central overdensity 5(r=0), and the ratio of baryonic to dark matter (Ikeuchi 
et al 1988). The minihalo model has the attractive feature of providing a natural explanation 
for the overall shape of the observed column density distribution function (CDDF). The large 
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observed dynamic range in column density reflects the strong density variations as a function of 
impact parameter, rather than a range in cloud properties. For the general case where the baryon 
distribution is an isothermal sphere (rif, oc r~^), the HI density in the highly ionized region of the 
minihalo drops like nni oc r^^ with radius r, and the resulting column density distribution seen 
by random lines of sight through a population of such halos obeys dM /cINhi oc N^jj'^ (Rees 1988; 
Milgrom 1988). The largest column densities, including damped Lja systems, are caused by the 
neutral cores in the shielded centers of the clouds (Murakami & Ikeuchi 1990). Thus minihalos 
can produce a column density power law over almost nine decades, providing a physical basis for 
Tytlcr's (1987a) suggestion of a common origin for all QSO absorbers. Evolution with redshift is 
caused by a number of processes (Rees 1986): When loosing pressure support as the ionizing flux 
decreases, gas may settle deeper into the potential well, thus reducing the geometric absorption 
cross-section, once stars are forming the UV flux may rise again, and stellar winds may blow out 
the gas (Babul &; Rees 1992), thus increasing the absorption cross-section. Halos are produced by 
a continuing turn-around of density peaks, and are destroyed by merging. 

A non-stationary version of the minihalo model was studied by Bond et al (1988), who 
examined the hydrodynamics of a collapsing spherical top-hat perturbation. If the accreting 
baryonic component escapes gravitational collapse (and subsequent star formation) it may 
reexpand under the influence of photoionization heating and even recoUapse after the UV intensity 
has ebbed (see also Murakami Sz Ikeuchi 1993). 

In order to investigate the relative importance of various conflnement mechanisms Petitjean et 
al (1993a) have studied a hybrid model, of spherical clouds with or without dark matter, bounded 
by an external pressure. These models show that pure baryonic clouds (as discussed by Black 
1981), in order to be stable against the outer pressure, tend to overproduce high column density 
systems. Many of the observed features of the Lya forest clouds can be explained with a single 
type of minihalo, but to match the fine structure of the column density distribution function halos 
may be required to exhibit a range of central densities (Murakami & Ikeuchi 1990; Petitjean et al 
1993b). Two separate populations, one for low column density Lya clouds, and one for the higher 
column density metal systems, give a better fit to the CDDF (Petitjean 1993b). 

Charlton et al (1993,1994) have studied gravitational condensations with a diflFerent geometry, 
modelling Lya clouds as equilibrium slab models that are subject to the pull of CDM gravity and 
to an external pressure. It was found that the change of slope in the column density distribution 
function (near log N(HI) ~ 15) can be explained by a transition between pressure and gravitational 
confinement, in the sense that at higher column densities gravity takes over and imposes a steeper 
dependence of the neutral column density with total column density. 

NON-EQUILIBRIUM AND OTHER EFFECTS POINTING BEYOND THE SIMPLE HALO MODEL 

With the adoption of the CDM based models researchers could avail themselves of the 
analytical apparatus developed to describe the dark matter distribution, especially the important 
concept of "halos" (Babul 1990; Mo et al 1993). Of course, there is a limit to the degree of 
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realism with which a counting scheme for dark matter condensations or spherical collapse can 
describe the observed properties of gas clouds, and even the notion of distinct "objects", dear to 
traditional astronomy, may fail. Hydrodynamic simulations (see below) show that in a hierarchical 
universe at intermediate redshift 2) most baryonic matter may not have settled in spherical, or 
rotationally supported virialized objects, as suggested by the word "halo" . Virial radii of objects 
capable of stably confining HI clouds are ~ 10 kpc (Rees 1986). The coherence lengths of Lya 
systems from gravitational lensing constraints (Smette et al 1992,1995) are much larger, implying 
that only few LOS ever hit the virialized region. Thus, minihalos may not only be embedded in 
regions of uncollapscd gas, they may still be accreting matter at the epoch where we observe the 
Lya forest. Thus it makes sense to look for signs of non-equilibrium, especially departures from 
thermal line line profile caused by the bulk motion of the infalling gas (Miralda-Escude &; Rees 
1993). Meiksin (1994) has traced the formation and internal structure of minihalos and slabs with 
hydro dynamical simulations to search for such observable non-equilibrium effects. For a slab or 
pancake geometry, noticeable deviations from Voigt profiles are predicted, but they would be hard 
to detect for spherical clouds. 

5. THE COSMOLOGICAL SIGNIFICANCE OF THE LYMAN ALPHA FOREST 

Over the past few years semi-analytical work and in particular hydrodynamic simulations of 
hierarchical structure formation have gradually led to a minor Copernican shift in our perception 
of the material content of the high redshift universe. If the inferences (discussed below) are 
interpreted correctly the intergalactic medium is the main repository of baryons down to redshifts 
at least as low as z ~ 2. If so, then high redshift galaxies - in absorption line parlance "Lyman 
limit" or "damped Lya systems" - are mere tracers of the matter distribution. The simulations 
show that the Lya forest is produced by a hierarchy of gaseous structures, with typical shapes 
changing from sheets through filaments to spherical galactic gaseous halos, as the column density 
increases. Perhaps most importantly, Lya forest lines closely reflect gravitationally induced 
density fluctuations in the general matter distribution. Given the relatively simple physics of this 
baryonic reservoir and the enormous sensitivity of the observations Lya forest spectra should 
make excellent and largely unbiased probes of structure formation at high redshift. 

THE LARGE BARYON CONTENT The fraction of matter incorporated into galaxies or still left 
in the intergalactic medium depends strongly on the structure formation model. To calculate the 
baryon content of Lya clouds we need to know the ionization correction, as most of the gas is 
highly ionized. For a given ionizing radiation field the degree of ionization depends on the density 
and thus, for a given observed column density, on the spatial extent of the gas. Deriving the 
mass content then requires fixing the size (or scale height) of the clouds either from measurement, 
or from theoretical prejudices. For example, the fraction of mass required to cause the observed 
amount of absorption can be quite large for gravitationally confined, extended, baryonic clouds 
(Black 1981). In contrast, the small baryon content expected if the Lya were caused by pressure 
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confined clouds (Sargent et al 1980) is largely a result of the small cloud sizes adopted. By using 

a suitable choice of parameters, the Lya forest can be made to contain anything from a negligible 
fraction up to virtually all of the baryons, and still be consistent with the observations (Meiksin 
&; Madau 1993). Specifically for the CDM minihalo model, Petitjean et al (1993b) found that 
the Lja forest clouds had to contain most of the baryons at redshift 2-3, in order to match the 
observed column density distribution function. This is in agreement with Shapiro et al (1994), 
who found that in a CDM model the fraction of baryons not yet collapsed into galaxies should be 
on the order of 50-90% . Independent of the cosmological model, the large transverse sizes of Lya 
absorbers measured from QSO pairs give another, indirect indication that the baryon density in 
Lya clouds must be large, or the absorbers must be extremely flattened (Ranch &: Haehnelt 1995). 

A FOREST OF LINES, OR A FLUCTUATING GUNN-PETERSON EFFECT ? 

Under the influence of gravity the intergalactic medium becomes clumpy and acquires 
peculiar motions, and so the Lya (or GP) optical depth should vary even at the lowest column 
densities (Black 1981; McGill 1990; Bi et al 1992; Miralda-Escude & Rees 1993; Reisenegger & 
Miralda-Escudc 1995). In a CDM dominated structure formation scenario the accumulation of 
matter in overdense regions reduces the optical depth for Lya absorption considerably below the 
average in most of the volume of the universe, leading to what has been called the fluctuating 
Gunn-Peterson phenomenon. Traditional searches for the GP effect that try to measure the 
amount of matter between the absorption lines are no longer very meaningful as they are merely 
detecting absorption from matter leftover in the most underdense regions. If this is not taken into 
account the amount of ionizing radiation necessary to keep the neutral hydrogen GP absorption 
below cTirrent detection limits can easily be overestimated. 

As another consequence, the distinction between the low column density Lya forest "lines", 
and the GP "trough", becomes somewhat artificial. Bi and collaborators (Bi et al 1992; Bi 
1993; Bi &; Davidsen 1997) have shown that the optical depth fluctuations corresponding to the 
linear regime of gravitational collapse in the intergalactic medium can give a remarkably realistic 
representation of the Lya forest (ignoring the higher column density lines, which are produced 
from non-linear structures, e.g., minihalo type objects). Their semi-analytical work is based on 
a log-normal density fluctuation field. For low densities where dissipation is not important the 
collapse of dark matter and baryons differs mainly by the presence of the gas pressure which 
eflFectively smooths the baryons distribution on scales below the Jeans length. Bi et al treated the 
pressure as a modification to the power spectrum of the baryon density contrast Sj,, suppressing 
power on scales below the Jeans length: 

where Aj is the Jeans length, k the wavenumber, and Sdm the dark matter overdensity. This 
method can elucidate many of the basic features of low column density Lya clouds. The schematic 
treatment of the equation of state and the lack of inclusion of shock heating limit the approach. 
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however, to overdensities of 5 < 5, where gas physics beyond the Jeans criterion is not very 
important. 

5.1. Hydrodynamic Simulations of the Lya Forest 

NUMERICAL APPROACHES From the early 1990s on hydrodynamic cosmological simulations 
became sufficiently realistic to be able to quantitatively predict the physical properties of the 
intergalactic medium and the high redshift Lya forest from the initial conditions of a given 
structure formation model (e.g., Cen &; Ostriker 1993). A Lya forest spectrum is completely 
specifed by the Hubble constant, gas density, temperature, peculiar velocity, and neutral fraction 
along the LOS. By predicting these quantities for artificial QSO LOS through simulated slices 
of the universe it becomes possible to examine the correspondence between Lya forest absorbers 
and the physical properties of the underlying gaseous structures. This approach was first taken 
by Cen et al 1994 (see also Miralda-Escude et al 1996) using an Eulerian hydro-simulation of a 
ACDM model. Since then a range of other numerical techniques have been applied to different 
cosmological models. The basic properties of the Lya forest turn out to be only weakly dependent 
on the cosmological model, and similar answers have been obtained with a variety of approaches: 
Petitjean et al (1995) grafted the baryons onto a COBE normalized cold dark matter distribution 
from an DM particle mesh simulation, using an analytic prescription to track the thermal history 
of the gas. A standard CDM model has been studied by Zhang et al (1995, 1997) with an Eulerian 
code, and by Hernquist et al (1996), with a Lagrangian, Smoothed Particle Hydrodynamics (SPH) 
technique. As a crude general rule of thumb the Eulerian codes are capable of higher resolution for 
the void regions producing the lowest column density Lya forest, whereas the Lagrangian codes 
are superior for regions like minihalos or galaxies where a larger dynamic range is required. Thus 
the use of SPH codes has been extended to study damped Lya systems (Katz et al 1996) and 
metal absorption systems (Haehnelt et al 1996a). Hybrid schemes (e.g., Wadsley & Bond 1997) 
can be tailored to capture the influence of both, large scale (long wavelength) gravitational effects 
and the small scale gas dynamics, on the formation of Lya absorbers. 

THE NATURE OF LYMAN ALPHA ABSORBERS Inspite of some quantitative differences a 
generic picture of the Lya forest has emerged from these studies: Low column density systems 
{log N{H I) < 14) are associated with sheet-like structures, not unlike small versions (length 
scale ~ a few hundred kpc to 1 Mpc proper) of Zeldovich pancakes. Gas accretes through weak 
shocks (creating a double humped temperature profile), and settles in a dense, central cooling 
layer, presumably to form stars. At the lowest column densities gas remains unshocked and just 
bounces back because of the hydrostatic pressure. The gas is partly confined by gravity and 
partly by ram-pressure. Higher column density clouds arise in more filamentary structures, with 
column density contours of log N{HI) ~ 14 extending continously and with relatively constant 
thickness (~ 40 — 100 kpc proper) over Mpc distances. With increasing column density the 
absorber geometry becomes rounder; column density contours at log N {HI) > 16 invariably are 
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spherical, entering the regime where the absorbers more closely correspond to minihalos; there 

the enclosed gas column is high enough to make the absorption system appear as a Lyman limit 
or damped Lya system. Figure 2 shows the spatial appearance of the Lya absorbers. The visual 
appearance of the low column density, sheetlike-filamentary structure has been aptly described as 
a "Cosmic Web" (Bond & Wadsley 1997). Looking at the higher column density, optically thick 
gas on scales of several Mpcs one gets a somewhat different impression of chains of mini- or larger 
halos, lining up like pearls on a string, quite similar to the structure seen in N-body simulations 
of the dark matter distribution. Confirming earlier analytical work, a large fraction of all baryons 
(80 - 90 %) resides in the low column density Lya forest, mostly in the column density range 
14 < log N (HI) < 15.5 (Miralda-Escude et al 1996). 

A glance at a typical density-temperature diagram (Figure 3) for random lines of sight 
through one of the SPH simulations (Haehnelt et al 1996b) reveals significant departures from 
thermal photoionization equilibrium for all but the highest density gas {uh < 10~^cm~^). The 
temperature density relation is generally steeper than the equilibrium curve, because the lower 
density gas cools by expansion, while the gas in the density range uh ~ a few times 10~^ - 10~^ 
cm~^ is heated by adiabatic compression or shock heating. Temperatures below lO^K occur in 
voids where the expansion velocity is largest. 

The gas is still being accreted at the epoch of observations (z ~ 3). Nevertheless, the lower 
column density flattened gas structures expand in proper coordinates because the gravitational 
pull decreases together with the dark matter surface density, as the universe expands. Many of 
the weaker absorption lines arise in low density, relatively extended regions, which expand with a 
substantial fraction of the Hubble velocity. The expansion, and the low temperatures due to the 
low density and the adiabatic cooling in voids ensure that at column densities (log N{HI) < 13) 
bulk motion becomes the dominant source of line broadening (Miralda-Escude et al 1996; Weinberg 
et al 1997). 

MATCHING THE OBSERVATIONS The simulations have been quite successful in matching 
the overall observed properties of the absorption systems, and the agreement ranges from the 
acceptable to the amazing. The shape of the column density distribution and the Doppler 
parameter distribution are reasonably well reproduced by the simulations. (Cen et al 1994; Zhang 
et al 1995,1997; Hernquist et al 1996; Miralda-Escude et al 1996). Although the approximate 
range of Doppler parameters is hard to miss (with photoionization being the great equalizer), 
subtle effects can raise or lower the mean line width by ~ 30% and change the shape of the 
Doppler parameter distribution. There may be some discrepancy for the Doppler parameters 
between different simulations (Zhang et al 1997, Dave et al 1997, Miralda-Escude et al 1996) but 
it is not yet clear whether this is due to different types of data analysis, different assumptions 
about the process of reionization, or limited numerical resolution. A departure from Voigt profile 
shapes, especially the broad wings of weak lines signifying bulk motion broadening in sheets, 
is seen in the simulations (Cen et al 1994) and appears to be present in real high resolution 
spectra (Ranch 1996). The large transverse sizes of the absorbers seen against background QSO 
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pairs and lensed QSOs are readily explained by the coherence length of the sheets and filaments 
(Miralda-Escude et al 1996; Charlton et al. 1997; Can &; Simcoe 1997). The weak clustering 
amplitude appears to be in agreement with the observations. The histogram of residual fluxes in 
the Lya forest is reproduced very well by the models (Rauch et al 1997). Conversely, we may take 
this as observational evidence in favor of some sort of hierarchical structure formation model. 

The evolution of the Lya forest with time at high redshift is mainly driven by the Hubble 
expansion and the resulting increase in the mean ionization of the gas, and to a lesser degree by 
the gas streaming along the filaments (Miralda-Escude et al 1996). Muecket et al (1996), from 
their simulation, find that the number of absorbers per redshift is given by a broken power law, 
with 7 ~ 2.6 (1.5 < z < 3) and 7 ~ 0.6 (0 < z < 1.5), [log N{HI) > 14) (Riediger et al 1998), a 
remarkable agreement with the observed data. The break in the power law can be understood as a 
change with time in the dimensionality of the structures dominating the absorption. The sheetlike 
absorbers dominating the high redshift Lya forest are expanding with time and are dropping 
below the detection threshold first because of their low column density, leaving the absorption 
from the less rapidly evolving gas distribution in the filaments and knots to dominate. There the 
column density also decreases, but since the original column was higher, the filaments remain 
visible for longer. Continuing infall also contributes to the increasing prominence of the more 
compact structures. 

5.2. The Lya Forest as a Cosmological Laboratory 

The first generation of simulations was largely aimed at establishing the physical properties 
of the Lya absorbers. The newly gained understanding of the nature of the Lya forest and the 
increasing realism of the simulations, together with new semi-analytic methods and novel ways of 
data analysis have brought quantitative cosmology with the low column density Lya forest within 
reach. 

Aside from the cosmic microwave background, the intergalactic medium is the only 
astrophysical environment for which observable properties can (at least in principle) be calculated 
from a simple set of cosmological initial conditions. This is because at z~ 3 the density fluctuations 
6 = p/p — 1 on spatial scales relevant for detectable Lya lines (on the order of 10^ kpc comoving) 
are not too far into the non-linear regime, so the history of the gas causing most of the low 
column density Lya forest has not yet been obliterated by virialization and dissipative processes. 
Overdensities between 5 ~ and 5 ~ 15 roughly correspond to Lya lines on the linear part of the 
curve of growth (12 < logA^ < 14), where spectroscopic measurements are most sensitive. When 
observing structures still dominated by gravity the problem of "bias" , one of the main obstacles 
to doing cosmology with galaxies, largely can be avoided. 

The link between the observable appearance of the Lya forest and the various cosmological 
input parameters can be described by the Gunn-Peterson relation for the HI optical depth. 
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generalized to include an inhomogenous density and velocity field. As long as the gas is highly 
ionized and in photoionization equilibrium (not necessarily thermal equilibrium), and the gas is 
unshocked, the optical depth is given by 

^ 0091 /iViio V f 5.2H{0) \ 0.7 fPy fl + zY ( dvpec 

This equation relates the optical depth for Lya absorption to the mean baryonic density (in 
gas) in units of the critical density, 0^, the Hubble constant at redshift z, H{z), the average gas 
temperature T, the proper baryon density p, the photoionization rate r_i2 in units of 10~^^s~^, 
and the gradient of the local peculiar velocity dvpec/dr along the LOS. A further convolution with 
a Voigt profile is necessary to include the proper thermal velocity broadening. To turn this relation 
into a complete description of the observed Lya forest, cosmology has to predict the cosmic 
density and velocity fields, the fraction of the closure density in the form of gas, the equation of 
state, T = T{p), and the ionizing radiation field. The exponent a {a=2 for an isothermal gas) 
takes account of the fact that in denser regions of the universe the gas is typically warmer because 
it is more effectively heated by photoionization, but a also depends on the reionization history of 
the gas and the amount of adiabatic expansion/compression. Hui & Gnedin (1997), and Croft et 
al (1997a) find values of a ~ 1.6 — 1.8. 

Cosmological parameters can now be "measured" by iterating simulations with different input 
parameters until the simulated statistics of t{z) (the mean absorption, correlation function etc) 
match the observed ones. Perhaps the simplest cosmological parameter combination to be obtained 
is related to the baryon density, Qi,. Given eqn. (|T7|) the optical depth r scales approximately 
with (r2/i5o)°/r_i2. Using an independent estimate of the photoionization rate r_i2, e.g., from 
the integrated UV radiation of QSOs, one can determine fij,. 

The simulations show that a rather high Q^h'^ is required to reproduce the amount of observed 
absorption, even for a conservatively low estimate of T (Hernquist et al 1996, Miralda-Escude et 
al 1996). If the ionizing background is given by the known QSOs alone and a Haardt & Madau 
(1996) spectrum (scaled to J_2i ~ 0.23, at z=2) is adopted, Q^h'^ > 0.017 (Ranch et al 1997). 
Although the observations of on which the result is based, are still somewhat uncertain, 
relatively large Qh values appear to be an inherent feature of hierarchical structure formation and 
cannot be avoided unless most of the low column density absorption dominating the Lya forest 
has a different physical origin (Weinberg et al 1997). 

COSMOLOGICAL PARAMETERS WITHOUT HYDRODYNAMICS Rerunning the simulations with 
different input parameters and/or evolving them over a long time span is expensive, as is the 
analysis of large observed and simulated datasets. A number of new semi-analytical techniques 
have been developed to avoid these difficulties. Although not "hydrodynamically correct" they can 
give new insights into important aspects of the sometimes obscure dependence of the observational 
properties on the underlying physical environment. Such techniques compensate for the absent 
hydrodynamics by various analytical recipes: Petitjean et al (1995), and Croft et al (1997b) used 
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dark matter simulations and assume that baryons (furnished with a suitable analytical thermal 

history) trace the dark matter directly; Bi ct al (1992), and Hui et al (1997) applied power spectra 
with various forms of cutoff to mimic the smoothing introduced by the Jeans length; Gnedin Sz 
Hui (1997), using a dark matter code, simulate the effects of the gas pressure by modifying the 
gravitational potential. 

THE LYMAN ALPHA FOREST AS A RECORD OF PRIMORDIAL FLUCTUATIONS Scmianalytical 
work by Gnedin & Hui (1996) and Hui et al (1997) has elucidated the relation between column 
density peaks ("absorption lines") and the statistics of density peaks, and has given analytical 
expressions for the dependence of the shape of the column density distribution function f{N) 
on cosmological parameters. The slope of f{N) was found largely to be determined by the 
normalization and the slope of the initial mass power spectrum, with changes in the equation of 
state T = T{p) having an additional, but smaller impact. The overall normalization of f{N) is 
given by (f2b/i^)^/r; a change in this quantity shifts f{N) horizontally to larger N. 

Croft ct al (1997b) have suggested a technique for recovering the initial power spectrum 
of density fluctuations directly from the fluctuations of the optical depth. The distribution 
function of pixel fluxes in a Lya forest spectrum on larger scales is assumed to have originated 
via gravitational collapse from an initially Gaussian probability distribution of overdensities 5. 
Then the flux probability function can be mapped monotonically according to the rank of the flux 
values back onto a Gaussian probability function for the initial 5. The density power spectrum 
(width of the Gaussian) P{k) is then known up to a normalization, which can be derived from 
iterative cosmological simulations with the same P{k) but different normalization until the right 
flux power spectrum is obtained from simulated spectra. The flux power spectrum is unique up to 
a normalization which can be fixed by observing the mean absorption D. 

POTENTIAL PROBLEMS - UNSOLVED QUESTIONS The new paradigm for the Lya forest has 
considerable explanatory power, but that does not mean that it is correct. The interpretation 
of the absorption systems, and the cosmological measurements planned or already performed to 
date depend on gravitational collapse as the dominant source of structure in the intergalactic 
medium. Even if the hierarchical models are basically correct, it is conceivable that local physical 
effects may upset some of the cosmological conclusions. A fluctuating radiation field may be a 
source of non-gravitational structure in the forest, as may be stellar feedback. How much of the 
absorption is caused by gas blown out by supernova explosions or stellar winds, and how robust 
are the cosmological conclusions in that case ? Metal enrichment has been found to be common for 
absorption systems with HI column densities as low as log N {HI) ~ 14 (Tytler et al 1995; Cowie 
et al 1995). If this is not due to a very early phase of metal enrichment we have to worry that 
some process other than gravitational collapse may have formed the metal enriched Lya clouds. 
The origin of the ionizing radiation and the spectral slope are another source of uncertainty. 
When and how do reionization and reheating happen, and where do the photons come from ? Is 
collisional reheating important, and how much do stars contribute to the UV flux, as a function 
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of time ? On the technical side: Do hydrodynamic codes already converge, or how much do the 
inferred cosmological parameters ($7^, the amount of small scale structure present) depend on the 
resolution and size of the simulations, and the numerical technique ? 

Finally, the cosmological picture itself could be wrong, and the interpretation of the forest as 
absorption mostly by the intcrgalactic medium (as opposed to distinct galaxies) may be doubtful. 
Galaxy halos or disks could be big/numerous enough to produce the low column density Lya 
forest as well. For low redshift absorption lines, this last possibility has received much attention, 
and we will briefly consider this question next. 

6. THE LYMAN ALPHA FOREST AND GALAXIES 

Is the Lya forest absorption caused by galaxies ? To match the large rate of incidence of 
typical Lya absorbers, "normal" (i.e., known types of) galaxies must possess very large absorption 
cross-sections (Burbidge et al 1977). Alternatively, since the rate of incidence is constraining 
only the product of number density and geometric cross-section of the absorbers, there could be 
a population of unknown, more numerous objects, subtending a smaller cross-section. Two key 
observations have fuelled the interest in the nature of the absorber-galaxy connection. One was 
the detection of apparently ordinary galaxies at the same (intermediate) redshifts as high column 
density, Mgll metal absorbers (Bergeron 1986). Subsequent work (Bergeron & Boisse 1991; 
Steidel 1995) established an incontrovertible connection between gaseous galactic halos and high 
column density, metal absorption systems (which we will not discuss here, as it is most relevant 
for optically thick Lyman limit systems). The other was the widely unanticipated detection of a 
remnant population of Lya absorbers in the local universe with HST (Morris 1991; Bahcall et al 
1991,1993), where the properties of an galaxy can be studied in much greater detail than at high 
redshift. 

6.1. The Low Redshift Lyman Alpha Forest 

Soon after the discovery of the low z absorbers, galaxy surveys in the fields of the QSOs 
observed by HST, especially near 3C273, were undertaken to investigate a possible link between 
absorbers and galaxies. Salzer (1992), Morris et al (1993) and Salpeter & Hoffman (1995) found 
redshift coincidences with galaxies for some of the lines, hundreds of kpc up to Mpcs away from 
the absorbers, but there was no unambiguous correspondence between absorbers and individual 
galaxies. Searches for any low surface brightness objects closer to the LOS to 3C273 which could 
have escaped detection, have been performed in HI radio emission (van Gorkom et al 1993), Ha 
emission (Morris et al 1993, Vogel et al 1995), and in deep broad band optical images (Ranch 
et al (1996), but were all equally unsuccessful. Morris et al (1993) concluded that there is some 
correlation between absorbers and galaxies, but the galaxy- absorber cross correlation function is 
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weaker than the galaxy-galaxy correlation. By trying to model the correlation results as a mixture 
of randomly distributed objects and galactic halos, Mo & Morris (1994) deduced that galaxy halos 
constitute only about 25% of the local absorber population. At first glance this is at variance with 
the result of Lanzetta et al (1995), who, based on their large galaxy redshift survey, concluded 
that most absorption systems are associated with galactic envelopes of typical radius 160 kpc 
(see also Chen et al 1997). Moreover, a significant anticorrelation between the equivalent width 
and the impact parameter of the LOS from the center of the galaxies was measured. Le Brun et al 
(1996)'s survey showed a weaker anticorrelation, and Bowcn et al (1996) saw none at all, although 
they both confirm Lanzetta et al's results in that there is a region with a high covering factor for 
absorption around each galaxy, within impact parameters < 200 — 300/i^^ kpc, dropping rapidly 
at larger separations. It appears that the conclusions of Morris et al (1991) and Lanzetta et al 
(1995) can be reconciled if the Lanzetta et al's main result, i.e., the existing of well defined galactic 
envelopes, is valid only for the relatively strong absorption lines used in their comparison. The 
weaker lines, from which Morris et al (1991) derived a weak galaxy-absorber correlation, could 
still be caused by a truly intergalactic medium. Absorption systems do exist in voids known from 
galaxy surveys (Stocke et al 1995; Shull et al 1996), but there appears to be a general trend for 
the absorbers to trace the same large scale structure as galaxies (Stocke et al. 1995; Hoffman et 
al 1995). In any case, the very large structures causing the stronger common absorption systems 
in QSO pairs (Bechtold 1994; Dinshaw et al 1994, 1995) cannot be explained by single objects 
like giant disks or halos: in those cases where several galaxies have been found at the same 
redshift as the absorber the typical transverse separation between the galaxies is smaller than the 
transverse absorber size (Ranch et al 1996). This is reminiscent of Oort's (1981) "uncondensed gas 
in superclusters" . There is amazing redshift agreement (velocity differences < Av < 20 kms~^) 
between the HI velocity centroids of galaxies and absorption systems with impact parameters as 
large as 300 kpc (van Gorkom et al 1996). 

MODELLING LOW REDSHIFT LYMAN ALPHA ABSORBERS Attempts at modelhng have mainly 
been concerned with the large cross-section required if the low redshift Lya clouds are parts of 
the known galaxy population. Maloney (1992) has suggested that the absorption arises in the 
distant, ionized outer parts of the known population of disk and irregular galaxies. Clouds that 
are pressure confined by a hotter gas in a extended galactic halo were discussed by Mo (1994). 
Salpeter (1993) has invoked a new type of extended low redshift disk galaxies which, in a short 
burst of star formation blow out their denser centers and disappear from view, while their gas 
cross-section remains (the so-called "Cheshire Cat model"). The large sizes and low column 
densities postulated require that these objects must have formed late (Salpeter &; Hoffman 1995). 
Again, observationally the large coherence lengths of the absorbers on the sky seem to correspond 
to groups of galaxies. To get the large covering factor right these objects must be so close together 
as to run into each other like circular saws at only slightly higher redshift, which puts us basically 
back at a continuous intergalactic medium. A number of other sources of low z Lya absorption has 
been considered, among them tidal tails (Morris & Van den Berg 1994), and galactic winds (Wang 
1995). Galaxy clusters have been seen to cause at least some absorbers (Lanzetta et al 1996), and 
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the strong clustering found among low z absorption lines (Boksenberg 1995; Bahcall et al 1996; 
Ulmer 1996) hints at the increasing importance of such structures with decreasing redshift. 

Clearly, one has to be open-minded regarding all these possibilities, many of which plausibly 
may contribute a significant fraction to low z Lya absorption. How much exactly may be hard to 
quantify (Sarajedini et al 1996). Again, believers in hierarchical structure formation can expect 
some consolation from simulations. Petitjean et al (1995) predicted a bi-modal distribution of 
absorbers, with large galaxy halos with typical radii on the order of 0.5 Mpc on one hand, and 
more frequent, lower column density intergalactic absorption occuring in filaments up to several 
Mpc away from the nearest galaxy, on the other. Miraculously, this is consistent with all the 
observational evidence we have. 

6.2. Metal Enrichment In The High Redshift Lya Forest 

True to our self-imposed restraints we will deal here only with the low column density forest. 
For the reasons already mentioned (large transverse sizes, small velocity differences over hundreds 
of kpc, probable flattening, absence of voids, weak LOS correlation, low Doppler parameters, 
and the low column densities themselves) the typical Lya system at z~ 3 is quite unlikely to 
be physically associated with a galaxy, other than being part of the gaseous matrix from which 
galaxies form. One puzzling result remains, however: the finding of widespread metal enrichment 
in the Lya forest. 

Individual high column density systems with very low metallicities (of order 1O~"^0) exist 
(eg. Chaffee et 1985), but there is no absorption system known with column density above 
log N (HI) > 16 and a primordial composition. The possibility that there may be a transition 
at a certain column density from a metal enriched gas to a primordial gas has led to intensive 
searches for weak metal lines in low column density absorbers. Norris et al (1983), Williger et al 
(1989), and Lu (1991) used a "shift and stack" method to search for various metals in the low 
column density forest. To maximize the signal-to-noise ratio the spectra are shifted to the rest 
frame indicated by each Lya, and added, and the expected positions of metal lines are searched 
for a signal. A tentative detection of CIV, corresponding to a carbon depletion relative to solar 
of [C/H]« —3.1 was made by Lu et al 1991. Meyer & York (1987) pointed out, that data with 
an increasing S/N ratio show increasing numbers of individual weak CIV systems. The subject 
attracted renewed interest when Keck spectra showed that most Lya systems with HI column 
densities 10^'' and roughly half of all Lya systems with column densities > 3 x 10^^ cm~^ have 
associated CIV lines, corresponding to a typical metallicity of Z~ 10~'^ZQ (Cowie et al 1995; 
Tytler et al 1995; Songaila & Cowie 1996). Unfortunately, the detection threshold for CIV is 
close enough to make it hard to determine whether the decreasing rate of detections is a genuine 
turnover to primordial composition below a few xlO^^, or just a selection effect. It is interesting 
that in the CDM models a column density contour of 10^^ at redshift 3 delineates the transition 
between a continuous filamentary structure in the universe, with typical widths of less than 100 



-37- 



kpc, and the voids. Galaxies would have to spill metals only within the filaments to create the 
widespread metal-enrichment observed, and they could still have left most of the volume of the 
universe pristine. Thus a drop in metallicity at a few xlO^^ would not come unexpected. A 
relatively uniform metal abundance across the whole column density range could be an indication 
of a earlier phase of nucleosynthesis. 

7. THE HELIUM LYMAN ALPHA FOREST 

Observations of absorption by the He I and Hell Lyman series provide another, independent 
source of information on the state of the intergalactic medium and the UV background radiation 
(Sargent et al 1980). Comparing the Doppler parameters of the HeH 304 A and HI 1215 A lines 
it is in principle possible to use the difference in atomic masses to measure the contributions 
from bulk and thermal motions to the line broadening separately, so theories of the kinematics 
of the cosmic gas can be tested. The far-UV Hell Lyman edge at 228 A probes the intensity 
of the UV background at much shorter wavelengths than the HI edge. As the photoionization 
rates are dominated by the intensity of the ionizing radiation near the respective ionization 
edges, measurements of the HcII and HI column densities can then in principle fix the spectral 
shape of the UV background in the vicinity of two points, 228 A and 912 A. This comparison 
can be done as a function of wavelength (or redshift) so it is possible to measure the spatial 
spectral fluctuations of the UV background caused by local UV sources and by fluctuations in the 
intergalactic absorption, and, perhaps at higher redshifts, to study the progress of reionization 
(e.g., Shapiro & Giroux 1987; Donahue & ShuU 1987; Miralda-Escude & Rees 1993; Shapiro et al 
1994; Madau & Meiksin 1994; Giroux et al 1995). 

In a photoionized optically thin gas Helll is the dominant ionization state; the remaining 
He is expected to be mostly in the form of singly ionized Hell. For realistic spectral intensity 
distributions (except for the very soft UV background caused by decaying neutrinos, Sciama 1990) 
Hel is undetectable in the optically thin clouds of the Lya forest proper, although it should be 
present in Lyman limit systems (Miralda-Escude & Ostriker 1992). Indeed, Hel yielded the first 
detection of helium at high redshift, when absorption by its 504 A line was found in HST FOB 
data of several optically thick (z ~ 2) metal systems towards the bright QSO HS1700-I-64 (Reimers 
et al 1992, Reimers Sz Vogel 1993). The ionization state of Hel is less easy to interpret because of 
the possible presence of internal sources of radiation, and unknown shielding effects. 



The Hell Lya Forest 

Because of its relative strength, Hell 304 A is likely to be a better tracer of the low density 
baryon distribution than even HI Lya. 
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The principal observable of the Hell Lya forest is the ratio of the Gunn-Peterson optical 
depths of Hell to HI: 

THI 4 iVni 4 ' JHell ^ ^ 

where A^Heii and iVni are the column densities of HeH and HI, respectively (Miralda-Escude 1993). 
The last equation is valid for an optically thin gas, where the ionization equilibrium is governed 
by photoionisation and both H and He are highly ionized. Jneii and Jhi are the intensities 
of the ionizing radiation field weighted with the frequency dependence of the photoionization 
cross-sections. Thus the relative strength of the GP troughs are only dependent on the ratios of 
the ionizing fluxes, a situation which can be cast in terms of the column density ratio rj or the ratio 
of the intensities at the absorption edges, the softness parameter Sl (Madau & Meiksin 1994), 

rj = ^^ 1.8^ = 1.8S,. (19) 

JVhI -'228 

The Hell/HI ratio rj can range from values of a few, to a thousand, depending on the spectral 
slope of the ionizing radiation. The shape of the ionizing spectrum depends on the relative mix 
between "hard" (AGNs) and "soft" (stellar) sources, and on the details of radiative transfer by the 
intergalactic medium (Bechtold et al 1987; Shapiro & Giroux 1987; Miralda-Escude & Ostriker 
1990; Meiksin & Madau 1993; Giroux & Shapiro 1996, Haardt & Madau 1996). 

Thus a Hell 304 A Gunn-Peterson trough should appear more prominent than the 
corresponding HI trough (Miralda-Escude 1993), allowing for a more sensitive measurement of 
the distribution of gas in low density regions. For the actual Hell forest of discrete absorption 
lines a relation similar to equation ( |l8|) holds, where r is now replaced by Teg as defined earlier 
(Miralda-Escude 1993): 
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This relation gives the optical depths for a Lya forest of individual lines above a certain optical 
depth threshold, assuming that the column density distribution of HI Lya lines is a power law 
with index /?. The Doppler parameters are ^HeH and 6hi. Clearly, together with the strong Hell 
GP effect there should be a Hell forest stronger than the corresponding HI Lya forest by a similar 
factor. 

OBSERVATIONS Only a small fraction of all QSOs are suitable for a search for Hell 
absorption. The short wavelength of 304 A requires an object to be redshifted to at least z>2 — 3 
for the Hell line to enter the far UV bands accessible to the Hubble Space Telescope (HST), or 
the Hopkins Ultraviolet Telescope (HUT). The QSO has to be bright enough for a spectrum to be 
taken, and most importantly, there must be flux down to the wavelength range of interest. The 
average blanketing of the spectrum by Lya lines (the "Lyman valley", M0ller & Jakobsen 1990) 
and especially the total blackout imposed by individual intervening Lyman limit systems below 
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912 A in their rest frame renders the large majority of QSOs useless for a Hell search (Picard & 
Jakobsen 1993), and surveys of known QSOs for residual UV flux (e.g. Jakobsen et al 1993) have 
to be mounted to select suitable candidates. 

To date there are five detections of the Hell forest. A Hell absorption "break" blueward 
of the Hell emission line was first seen with the HST FOC far UV prism by Jakobsen et al, 
1994 in the LOS to Q0302-003 (2;em=3.29), leading to an estimate for the mean optical depth, 
THeii = 3.2^^j^. The object was reobserved at higher resolution with the GHRS instrument by 
Hogan et al (1997) (thcII ~ 2, beyond the proximity effect region). Tytler et al. (1995) obtained 
''"Hcii = 1-0 ± 0.2, later corrected to rneii > 1.5 (Tytler & Jakobsen, unpublished) in the LOS 
to Q1937-69 (zem=3.18). Davidsen et al (1996), observed the object HS1700+6416 with HUT 
to obtain THeii = 1.0 ± 0.2, at < z >=2.4. Reimers et al (1997), in the LOS to HE2347-4342 
(-2em=2.89) find the Hell absorption to consist of patches with a high continuous GP component, 
THeii = 4.8^^ in addition to the contribution expected from the discrete lines, which alternate 
with regions with less GP absorption thcII ~ 3. 

INTERPRETATION Given the large uncertainties, all r measurements to date seem to be 
consistent with each other, if the expected increase in the optical depth with redshift is taken into 
account. Constraining the strength and shape of the ionizing radiation from the absorbed flux 
requires a knowledge of the dumpiness of the gas, because of the exponential dependence of the 
absorbed flux on the optical depth. According to equations (|l8|) and (|20|) the relative strengths of 
the absorption by HI and Hell depend on the amount of bulk motion relative to thermal motion, 
and on the column density distribution function (slope and possible cutoff at low column density), 
and the relative contribution from a diffuse absorption trough. Arguments have been put forward 
both against (Songaila et al 1995) and in favor (Hogan et al 1997; Reimers et al 1997; Zheng 
et al 1998) of the existence of such a trough in addition to the line absorption expected from 
translating the known HI Lya forest into a Hell forest. If the proponents of additional trough 
absorption are correct this may also imply that the HI column density distribution function has 
been over-corrected for confusion, and does not extend to as low a column density as previously 
assumed. Superficially this argument sounds like the return of the lines-versus-trough debate 
familiar from the HI Gunn-Peterson effect, but there is new information to be gained by studying 
the detailed structure of the low density Hell absorption. The larger optical depth of Hell 
highlights very low density structure in voids, which may be too weak to be usefully constrained 
with optical HI Lya forest spectra. Eventually such observations will constrain the spatial 
fluctuations of the ionizing radiation field and the density field in a large fraction of the volume of 
the the universe. The question of whether the spatial variations of the diffuse absorption can be 
(or should be) parametrized as "lines" may have to await the arrival of better data. In any case, 
the finding of a substantial amount of Hell absorption from voids is an important consistency 
check for hierarchical structure formation models (Zhang et al 1995, 1997; Croft et al 1997a). 

At the time of this writing the spectral shape of the radiation field is still not well constrained 
(Sethi & Nath 1997; Reimers et al 1997; Zheng et al 1998). An interesting twist has been added 
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by the detection of patchy Hell absorption, which is inconsistent with a uniform radiation field. 

Reimers et al (1997) invoke incomplete reionization of Hell as a possible explanation, an effect 
predicted to produce saturated absorption troughs (Meiksin & Madau 1993). However, it is hard 
to tell how strongly saturated the troughs really are. The observations may still be consistent 
with a fully re-ionized HeH, if the troughs are caused by local fluctuations in the HeH ionizing 
background (Miralda-Escude 1997). 

8. PROSPECTS 

Although most of the observational basis and many theoretical aspects of Lya forest absorbers 
had already been established over the past two decades, high signal-to-noisc spectroscopy of QSOs 
with large telescopes, the extension of the wavelength range into the far UV with satellites, and the 
success of hydrodynamic cosmological simulations have begun to turn the study of the Lya forest 
from a somewhat esoteric appendix of cosmology into a cosmologically useful tool. If our current 
understanding is correct, the high redshift Lya forest absorption is the observational signature of 
most of the baryons throughout most of the history of the universe. Perhaps most importantly, 
we are looking at the typical fate of matter, without any reference to luminous objects. 

The new general picture of the forest that has emerged is still in need of more secure 
observational conformation, before we can trust any quantitative cosmological conclusions. The 
simulations agree with some aspects of the data, but arc they unique, and consistent with each 
other ? More detailed comparisons with the data arc called for, partly with new techniques of 
data analysis tailored to maximize the discriminative power. Semi-analytical work still has an 
important function in guiding our understanding of the actual physics, and in exploring parameter 
space quickly. The observers need to explore the limitations of the observational techniques, and 
systematic effects in the data, formerly gracefully hidden by a veil of noise, but now exposed by 
large mirrors to the strict eye of numerical theory. 

We can expect new observational facilities to enlarge the scope of absorption line studies 
considerably. The projected Cosmic Origins Spectrograph (COS) will increase the spectroscopic 
efficiency of the HST, benefitting almost all of the observational areas mentioned here. The 
Sloan Digital Sky Survey (SDSS) should produce large numbers of QSOs useful for spectroscopic 
follow-up, to study (for example) the large scale structure from intergalactic absorption in three 
dimensions. Even low resolution QSO spectra will be useful for cosmological purposes. And 
the use of large optical telescopes is inevitable for studies of gravitationally lensed QSOs, the 
absorber-galaxy connection at any redshift, and of course for most projects involving narrow, 
metal absorption lines, a subject of increasing relevance for our understanding of the process of 
galaxy formation. 

Unfortunately, other applications of absorption lines like the remarkably militant debate 
about the deuterium to hydrogen ratio, the whole topic of intervening metal absorption systems 
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and its relevance for galaxy formation, and the process of reionization could not be treated here. 
Perhaps we have ignored them with some jTistification; these subjects are currently in such a state 
of flux that any review could be out of date before going to press. 
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Fig. 1.— High resolution (FWHM « 6.6 kms-^) spectrum of the = 3.62 QSO 1422+23 (V 
= 16.5), taken with the Keck HIRES (signal-to-noise ratio ~ 150 per resolution element, exposure 
time 25000 s). Data from Womble et al (1996). 
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Fig. 2. — HI column density contours for a slice of the 10 h ^ Mpc (comoving) box from the ACDM 
simulation by Miralda-Escude et al (1996) 



-55- 



photoionlzation equllibnum 




Fig. 3. — Density - temperature {n — T) diagram of the Lya forest at redshift 3.1 from an SPH 
simulation of a standard CDM universe (Haehnelt et al 1996b). Each dot represents the mean 
values of the total hydrogen density n and the gas temperature T along a random line of sight 
through the simulated box. The solid curve gives the locus of thermal photoionization equilibrium. 
Departures from this curve are due to the dynamical nature of the universe. For all but the most 
dense regions expansion cooling in voids (low density regions) and heating by compression and 
shocks during gravitational collapse steepen the T{n) relation compared to the equilibrium curve 



